"It was never meant to be an affair."