"Not the point. When we were married you were the only woman..."