"For heaven's sake, Robbie Ray, I wasn't gonna hit him."