I can't believe the paranoia rampant in this thread! "Monsters lurking in public toilets"?! I think it's a huge problem of modern society that people are living in fear like that.
When my son is able to look after his own toileting and is comfortable/asks to go into the men's toilet, he'll be allowed to! I presume that's about 6-7 or so.