Thanks!
I think I've heard them called 'river rats', possibly in the books about Tom Sawyer and Huckleberry Finn by Mark Twain (Samuel Clemens).
Try looking at period fiction if you are looking to learn the vernacular of that era :)
Ferryman (two coins for the ferryman)