Preferences vs Ethics

Since I suspect the selection of people I could potentially get along with is rather small, I don't hold with the idea that everyone I dislike is inherently a bad person.  Some of them are, I believe, but even those people are capable of doing good things (though they may not exercise that capability).  My point is that I sometimes think that people divide the world up into 'good people who deserve good things' and 'bad people who deserve only death' according to...what people they personally like and could stand to be around.  And even without the rather disconcerting binary this creates (there are only good people and bad people, never in-between people), this elevates one's personal preferences and conflates it with morality and ethics. 

I don't think that everyone I dislike is a bad person.  I don't even dislike everyone that I avoid.  I know that my ability to get along with people is contingent on a large number of factors, but not all of those are ethical or moral factors.  And that's okay.  It's okay to just not like someone.  There are also people I dislike for doing bad things, but I will say that I definitely do not consider all of those people morally equivalent in their misdeeds! 

I guess what I'm trying to say is that a lot of the time I get an 'us vs them' and 'you're either with us or against us' vibe from a lot of discussions regarding politics or ethics.  I feel like there's a lot of conflation and intertwining of judging people according to personal preferences and judging them according to ethical principles, which doesn't seem right to me.