""Increasingly, those of us close to the prime minister"