the barges were quickly pulled to shore , and the rebels , their makeshift scaling-ladders already raised , swarmed on board and began to pole their way rapidly across the moat to the sheer castle-wall .