"there will also be ''siege markers""near the starting points, but the markers will be tough to spot and it'll be easier just to wait for the caravans to start arriving."
once you know the starting points of the caravans, try to put some ballista towers in the area.