As someone who does tend to sympathize and overlook a lot of the negatives against Neal, I do have to agree I’d be pissed with him being angry at Emma giving Henry up for adoption. Whatever his motives were, he removed himself from that situation. And, IMHO, probably made it impossible for Emma to track him down.
He probably is working under the assumption that as much as he’s messed up – his shady past at least gave Emma and Henry a jump start in a better life (watch money). So when it does come out that Henry wasn’t raised by Emma, that she never got the money and probably didn’t find herself in a situation where raising him was a possibility, I see his emotions delving more into self-hate, being reflective about how thing might have been. Of course, I’m expecting a scene with August about how he had ruined the possibility of this family unit – in multiple ways.
I guess I don’t see the function of having him angry at Emma over this, plotwise. Maybe, if he hadn’t seen the keychain and wasn’t likely to see the yellow bug – and because of this thought Emma threw Henry away because she wanted nothing of Bae in her life – here I could see his abandonment issues coming into play and have Neal act out – I’d still be pissed with him but it could create more tension then just a scene of him throwing a fit and Emma explaining to him her circumstances. Who knows, though! 😀