"But I guess the kids can come and visit you any time they want"