"And if they didn't, you would fall out of favor,"