Maybe it isn’t always a hat. The Red Queen didn’t seem to know what the Hatter used to get to Wonderland because she asked about it, but she had the Queen’s father which makes me think someone went to Fairytale land and brought him back so they must have a different way of walking between worlds.