"Look, I wasn't serious about you taking Sam..."