"Well, I'm afraid Lord Caldlow was adamant"