With a new developer in the neighborhood and longtime Farmers' Restaurant closing, some are nervous that historic market could see rush of changes in next few years.