"But I am his mom, and I think he'd be devastated"