To the predictions should be measured using unknown patients (unknown: never appeared in the process of building the model including any data-driven pre-processing that takes all cases into account).
For a traditional quantitation in chemometrics, the validation has steps that need further independently measured test data :...- cbeleites Apr 12 '12 at 15:48.