Both Torsken Church and the village are mentioned in written sources from the Middle Ages and it is possible the church was already there before the Black Death in 1349. A survey from 1770 describes the church as a small cruciform church in a dilapidated state. Some years later it was dismantled and moved 25m eastwards to be inside the old church yard. The work was competed in 1784. When the church was renovated in 1967, it was painted red which makes it a landmark throughout the year.

There are indications of some of the logs from the old church being reused. The current church also went through another, by some regarded as insensitive, renovation in 1866 which saw the wooden roof shingles replaced with slates and the external walls being clad with white painted clapboard.