the builders of garrison had used the old granite bones of the hills on either side of the fortress to serve as its north and south walls , and they were little more than a sharply sloped face of rock .