"But you always knew where you stood with him."