There many causes when gay men were still attacking women, just not rape them. So they are "safer" to women than other males in general, but safer does not mean "completely safe".

And allowing everyone in women's toilets is not a solution. Public women's toilets already have 2 times less spaces than men's toilets (because of urinals), women's toilets are used for menstrual needs as well, so women will use toilet longer on average, more often, and require more safety, and at same time women whave two times less places already. So putting more people to go into women's toilets will make situation even worse for women, as there can appear deficit of places.

Men need to sort out violence between themselves, to protect gay and gnc men much better, and de-stigmatize them in society. "Just combine them with women" is not the solution, and will fix nothing, only hurt women in long run. Women has nothing to do in men versus men problems, so it is just wrong to use women as shield in that fight.