How do I deal with my boyfriend's narcissistic brother?

You're letting his brother win, and his brother knows this. Plain and simple. Don't let him get to you, and there will be no problem.