"A vote of no confidence and he'll be toppled."