Maybe George was bluffing and James knew it. George might really be James’ father, from a secret affair long ago. George is extremely bitter about something; could be that his father forbade him to marry his true love or have any contact with her because she was a peasant.