What do you think is driving this behavior? I could think of a few things. Understanding the behavior is often key to finding the best remedy. Up until this point, it appears that life has worked out better for him if he acts this way, than what he has tried before. There may of course be even better strategies that he has not attempted.
Perhaps his behavior has won him favors among his peers, such as popularity, or climbing a few ranks in a pecking order. In that case, he may need direction as to what behavior is rewarded in this new context. They're only just dabbling with adulthood, after all.
Perhaps more crucially, this behavior is winning him the appreciation of your daughter in particular. Perhaps this distance between you and her that you mention is the cause here, and not the effect. Again, they're on the doorsteps of being adult, but they're not yet there. They know it will soon be very important for them to get by on their own, and they yearn for independence. Perhaps having something that mum and dad won't like and share is exactly what's exciting. In that case, you may need to back off a bit, and volunteer some distance, so that they don't feel the need to create it.
And that need for distance is something that could come from either him or her, and it's provably not a consciously formed strategy on their part, but either way, granting some extra freedom, space, independence, trust, may help remove that need.
Now, it's a perfectly valid concern to care for how the rest of your family members are being treated, so I think addressing that directly is also on the table. I don't think you'll have much to gain by making a general point about his character, but rather, it would have to be a case by case reminder that you don't appreciate that tone. Even then, I think any progress here will likely be too gradual to really notice.
You're also saying that you would like to show dominance in the house. That's a warning flag for me. For one thing, it won't work. Coming at this from a position of power will have a negative effect. He will feel the need to defend himself. You want him to agree with you, but that becomes almost impossible in this scenario.
More importantly, though, it is at odds with more important goals. You say that you don't want to drift further apart from your daughter. Well the only authority you have is over your home. So if you are playing out those cards, chances are they will just take their undesirable behaviors and influences to an arena outside of your control (and with that, insight). Your daughter is almost adult, but only almost. You could argue with me that you still have a right to veto her companions, but not without the cost of alienating yourself to your daughter.
Keeping all of that in mind, my ideal approach would be to present your concern, and ask your daughter what the solution is. Something down the lines of:
"Hey, I see that you really enjoy hanging out with X. I'm really happy about that, but at the same time, I bet you've seen how I think he can ruin the atmosphere around here when he does X and Y. I get that a lot of that is probably just me being old and I need to get along with how people talk these days, but I also think that everyone can at least be expected to Z. As your father, I am off course excited to embrace him as part of the family, but that's not really working for me right now. And I also get that this family is the least of your concerns right now, and that you probably only want to do your own thing. I respect that, and if you want me to back off and leave you two alone a bit more, that's what I'll do. But if you think that this one is a keeper, and you want to bring him into our family, you need to remember that in this family we're nice to each other. The two of you will have to make that work."