"He hated me for it, for a time."