Just a thought on the whole “the bean was supposed to take him to a land without magic”-thing, is it possible that he actually did come here first, and then, since he’s pretty much a lost boy (orphan in a strange land), went on to Neverland afterwards? He only needed to stay here a short while.
And as i’m writing this I also realized that maybe that has something to do with his coming back here every now and then, wondering if his dad somehow got through anyway… at least at first, later it might have just become habit… though maybe not…