Hermit Island was home to a number of quarries for its brownstone from the 1860s to the 1890s.
Hermit Island has gone by other names in its history, including "Ashuwaguindag Miniss" (Ojibwe for "The Further Island"), Illinois Island, Austrian Island, Wilson's Island and Askew Island.[1]
It is nearly 2 nautical miles (4 km) long, lying 2 nautical miles (4 km) west of the northern tip of Madeline Island.