"No more than 20 of us colored boys"