Beaman the "bean man"

I’ve been thinking about Beaman (aka William Smee), who makes a profession of acquiring precious items for other people. We know that he either traveled by ship to other lands or had connections with sailors who did. Where exactly did he get the magical bean and from whom? The Blue Fairy said in The Return that the beans had been stolen from the EF, except for the one she gave Baelfire. Well, I have a feeling that the person who stole the beans from the EF and the person whom Beaman/Smee got the magical bean from is one and the same person, and I think that person could be Jack from the Jack and the Beanstalk fairytale. We also know we're going to meet the giant in 2×6, and there was a casting call for Jack back in July.