"People always assume it was because of the Duchess,"