"Losing Charlotte screwed him up really bad."