"It means a lot to Lady Mary and the family that we're married in the house"