very occasionally a few black men might be glimpsed on shore , observing them in turn with wary attention ; but for the most part there was only silence , watchful silence , except for the shrieking of birds .