"So I swore Phipps to silence and decided to stay on as your private secretary."