1. A method, in a data processing system comprising a processor and a memory and implementing training logic for training a Question and Answer (QA) system of the data processing system, the method comprising: configuring the data processing system to cause the data processing system to execute the training logic for training the QA system based on an augmented answer key data structure; receiving, by the QA system, a training question; processing, by the QA system, the training question to generate a final answer to the training question and supporting evidence for the final answer based on an electronically stored corpus of information; analyzing, by the training logic executing in the data processing system, the supporting evidence to identify one or more evidence attributes; searching, by the training logic, a plurality of correct answer entries in an answer key associated with the training question, to identify a matching correct answer entry in the answer key that matches the final answer, wherein the answer key is a data structure storing known correct answers to correlated training questions in a training question set data structure; augmenting, by the training logic, the matching correct answer entry in the answer key to include the one or more evidence attributes, to thereby generate the augmented answer key data structure; and training, by the training logic, the QA system, based on the augmented answer key data structure, to generate a trained QA system.