The issue here is that trans women don't "identify" as men yet want access to men's spaces. It's like when trans men get arrested and suddenly they want to be put in the women's prison even though they don't identify as such.

Those of us who are on the side of biology are well aware that trans women are male and trans men are female. However the problem OP's post is addressing is how, using TRAs own logic, it makes no sense to allow trans women in gay men's spaces.

what is the difference between my presence in the space and a drag queen?

The difference is a drag queen knows he's a man and doesn't try to pretend he isn't. He's not trying to be a woman,. He knows he's a man in drag. Trans women, whether they pass or not, are trying to distance themselves from being men and in doing so lose the ability to have access to certain things when it's convenient. This is why we want to drop the T. All it does is overcomplicate things unnecessarily when discussing LGB issues. You don't "need" one or the other. Yes you should rightfully be excluded from women only spaces because you aren't female. However, actions have consequences. If you willfully distance yourself from being a man by calling yourself a trans woman, non binary, or whatever, the consequence is you lose access to male only spaces. Because the men in those spaces aren't trying to separate their identify from their maleness.