It’s easy to sit on the internet and say “Oh you were born male, use the men’s room,” but that’s not practical in real life is it? It’s safest for me to use the women’s room and if the people who said this were in my shoes, they would be protecting their safety too.
Most people can’t tell I’m trans, and in the odd instance where someone might have an idea, they don’t bother me because they’re not a chronically online fearful weirdo and trans people are normal.