"I thought he'd gone off the wagon because of me."