Trickster- to use your example- telling someone “You’re not my brother” doesn’t necessarily allude to the fact that the person saying it does, in fact, have a brother. “Brother” doesn’t always mean sibling. My family has belonged to a MC Club for over 25 yrs and there are over 90 members. Of course they are not all blood related, yet, they refer to each other as ‘Brother’.
If a rival club member approached one of them and addressed them as ‘Brother’, the natural response would be, “You’re not my brother.”