Silverton Church, Silverton CO | Photo by Ken Hirdock (saxonfenken) via Flickr. Silverton is one of the highest towns in the United States, at 9,305 feet (2,836 m) above sea level. It is a fascinating little mining town where time seems to have stood still. all the house's and shops retain a very old charm.