"I think it would've worked against us, I really do."