American Sponge diving. Key West The history of sponge fishing in America begins, almost coincidentally, back in the early 19th century. A small sponge industry began with the settlement of Key West. Native Key West fishermen found sponges washed on the shores after storms. These sponges became the reason for the formation of a small fleet of "Hook Boats.