Jonas Gahr Stoere, Norway's Foreign Minister, had visited the island on Thursday, where he spoke to supporters at the camp.
Behind them, people stripped down to their underwear swam away from the island towards the mainland shore, some using flotation devices.
Earlier, a bomb ripped open buildings in the heart of Norway's government in the capital Oslo.
Sponheim said the arrested man also was linked to the bombing in Oslo.