"But her ladyship said we were to enjoy ourselves."