"He said that if I didn't look after you, he'd come back and haunt me."