to be sure , the remnants of the palace of knossos could be seen outside the city proper , but it was for historians to note that the saracens had chosen this spot to found chandax because it had been the main port of the minoans thousands of years earlier .