I think he is leaving the same reason he tells Regina to leave. If everyone remembers who they are, they are going to be out for blood. Gold may not be in the book but they will remember who he is. Baelfire is just a side mission at this point, survival is a primary mission. Curse breaks they can come and go from SB and everyone will be all over Gold and Regina like white on rice.
[adrotate group="5"]