"He only took me there on special nights when he had to make up for something."