"A number of others I've spoken to have gone from supporting her..."