in fact , so intent were the continentals and militiamen on their retreat that none of them did notice him , until one man turned away from the retreat , seeming to search the upper reaches of the shore for something .