I think it’s Gold talking to Emma.
If that exchange took place between Rumple and Bae, it would be the other way around….Bae would be the one saying that to his father, because his father is the one that broke a deal with him.
I don’t see Rumple saying that to Bae.
That’s the whole conflict between Rumple and Bae….Rumple is the one that broke their deal and he know’s it.