"I knew if I told you I was leaving, you'd try and stop me"