nearby stood the crumbled , skeletal ruins of a ninth-century carolingian castle , which had been built on the site of a prankish fort , which in turn was on the remains of the fortified roman camp that had preceded it .