"It broke my heart when you had to leave baseball."