"Maybe I didn't always confront him when I should have."