Martin Ferguson didn't want to talk to the #nuclearfamily and left in a huff