Didn’t Regina say that she pulled Jefferson into fairytale land suggesting that it may have not been all of the other realms that were pulled in, but just those from fairytale land who were elsewhere or even just those that Regina chose to pull in.
If the curse pulled FTL persons from other realms, that means that Baelfire who was in another realm has been transported to this world too! That is unless he has been dead for years.