"We understand that not everyone is for the town"