"They're never gonna let a colored person cross that line."