"I never asked him to leave his wife. I encouraged him to get counseling."