A proposal to demolish the more than 200-year-old former Palmer’s Restaurant building would clear the way for a 12-unit residential development on Elm Street.