"I just think we need to go spend some time as a family."