I think it’s okay if he’s mad because, at this point, he doesn’t know she didn’t get the money. Logically, I could see him not understanding why she would give him up given her (and Neal’s) issues when it came to abandonment and as long as he thinks she got the money, Emma wouldn’t have much of an excuse to give up her kid. That’s not what happened of course, but Neal doesn’t know that yet.