An Evaluative Comparison of Techniques for Measuring Student System Knowledge of Avionics Troubleshooting

Intelligent tutors have the potential to enhance training in avionics troubleshooting by giving students more experience with specific problems. Part of the success of these tutors will depend on their ability to assess and diagnose the student's knowledge in order to direct pedagogical interventions. The broad goal of the research program described here is to develop a methodology for assessment and diagnosis of student knowledge in the domain of avionics troubleshooting. One step towards this involves the identification and evaluation of techniques for measuring students' system knowledge in the domain of avionics troubleshooting. This step is the focus of the research described in this report. Thus far, the results of this research program have (1) developed a means of identifying meaningful action patterns in on-line student-tutor interactions, (2) identified techniques for measuring students' system knowledge which predict troubleshooting performance, and (3) described how these techniques contribute to on-line student-tutor assessment. Prepared in cooperation with Rice Univ., Houston, TX.