"Time went on, the neighborhood got rougher."