"I can't do it with him. Too much history, it's not right."