"And the more they reminded me, the more I knew I couldn't come back"