"I am not spending it with some gossipy mom ..."