"But once he saw me startin' to do better, he kind of regressed."