"He said it would make it too hard for him..."