"Wouldn't want Congress working with the wrong president."