"But I don't want to stand in the way of your happiness."