he had made his home and office in one of the structures built on the outskirts of the grounds-eyesores , but eyesores that were built like fortresses , sturdy enough to withstand a siege , with outlying buildings in which an enormous force of guards was housed .