After its construction Adderton was located on 2 acres on what was known as Duncan's Hill but the site is now perceived, after the cutting down of Ann Street, as a cliff face to Ann Street sloping south eastward to the Brisbane River.