"I'm just not sure his life and your life fit together."