"You believe a servant would ever have the time to be Lady Whistledown,"