Whether or not it's rude to drink in front of somebody who can't, it's generally considered impolite to bring your own booze unless instructed to do so*. If you can't socialize for a few hours with your friends without drinking, whether or not you get "wasted", then you either need new friends or you need to seek help for your alcohol dependence.

* I don't think there are any medical conditions or religions that would require one to drink alcohol when others are not consuming, but if so that's obviously the exception here, just like it's okay to bring your own food if the food being served is truly unacceptable, but it's usually not okay to bring it just because you prefer pizza to burgers.