"It will look like we've encouraged the Queen's sister to betray her husband."