"It's not fair to him."