"Why would the neighbors just assume that you're a racist?"