Automatic Generation of Training Cases and Answer Key from Historical Corpus

Mechanisms are provided for training and operating a Question and Answer (QA) system pipeline. A corpus of information is received which comprises historical data to which one or more filter criteria are applied to extract filtered historical data relevant to a training objective for training the QA system pipeline. Attribute data, action data, and temporal characteristic data are captured from the filtered historical data. An answer key entry is automatically generated in an automatically generated training answer key data structure based on the attribute data, action data, and temporal characteristic data. The correct answer associated with the answer key entry is an action specified by the action data. The temporal characteristic data provides a historical context for the answer key entry. The QA system pipeline is trained using the automatically generated training answer key data structure.