Concerning the "I never liked x because of white supremacists": there's a categorization problem with that. Some would say racial supremacy is enslavement (think 19th century Democrats), some would say is legal prejudice against free peoples (again, 20th century Democrats), others would say it is any advocacy of structure among power at all (21st century Democrats).

When everyone is guilty of the latter category in some way, you get the whole 'everyone is racist' nonsense. Ironically, even the unapologetic neo nazis don't really argue for the first category. So that really means it's just people bickering about where in the spectrum they should fall (and therefore others shouldn't) among societies' responses to unequal issues in the real world. Or you could take the pure conservative approach of going full color blind and taking every single action necessary regardless of its unequal repercussions even when it enrages basically everyone else. Like, only allowing immigration from historically connected countries proven to assimilate well without regard to racial effects. And when that results in only white immigration, just ignoring everyone reacting emotionally. Good luck ignoring the shriekers.