late in the afternoon , they rounded a curve and saw the large castle perched atop a crag on the far side of a desolate field where ruined houses stood huddled together as if fearful of the bleak structure glowering down at them .