I actually thought it when i read that. Neal is the only person who has a real reason to go and stay in Storybrooke.
If you don’t stay there, you can go, spend a couple of weeks, visit the port, and enjoy Granny’s hot chocolate without noticing anything especial. One could maybe percieve something odd, but would probably forget soon about it, since no one would even think about curses and fairytales.
Unless you get trap in something, like… It would be nice if the curse in the boundaries works in the opposite way, and if a person from our world crosses it, that person creates FairytaleLand memories. 😆