I don’t think Bae hates magic but I can see him being reluctant to use it especially since it turned Rumple into the dark one and caused them to be split up.
With all the parallels of magic being an addiction, I wonder if they’ll do a story arc of Emma getting hooked on magic. At the moment she has magic but doesn’t really know how to use it. Once she learns how to use it perhaps she’ll start using more and more.