"Rory, I don't want them to go. It'll just hurt them, and me."