"You couldn't leave your father and the girls."