You would receive excellent responses to this question over at /r/Norse. They should tell you that it is voiced - more softly than an American 'r' but voiced nevertheless.

The way I've learned it is to voice and trill it slightly, as with most rs in Old Norse. It's a weird sound for people not used to it, like the ll -> tl sound.