A building that has a long and storied history and was home to the Midway Diner has been demolished.