No, everyone benefits from a free speech platform. Freedoms are always tested against the least popular groups first. The fact that they are the first to show up elsewhere follows naturally. The more bannings take place, the more interesting this community will become. Until a tipping point is reached, and the average user prefers the freedom.