"I'm not talking about going after the whole union."