"He doesn't think he could do it as Speaker of the House."