in times of peace , they would have encountered fisherfolk in their skiffs , grain barges being poled downstream , merchants selling needles and bolts of cloth from floating shops , perhaps even a gaily painted mummer 's boat with quilted sails of half a hundred colors , making its way upriver from village to village and castle to castle .