while the invasion of last winter did not succeed , colonel arnold 's men determined to deny sir guy access to the lakes , and thus sank or burned all the ships at fort saint-jean as they withdrew , as well as burning the sawmill and the fort itself .