"You can't buy into the gossip in this town."