The castle was built from the local orange/brown sandstone, on a promontory above Kilton Beck, some 300 feet above the beck itself, with steep valley walls leading upwards from the water to the castle.