"Then maybe you can't be part of my life."