As long as the temperature stays below freezing, the Apostle Islands ice caves are open to the public. Located in Bayfield County, the Apostle Islands are 370 miles from Milwaukee and take six-plus hours by car, depending on weather.