Delivering Training Assessments in a Soldier Centered Learning Environment: Year One

The Army Learning Model (ALM) discusses the importance of using valid and reliable assessments in training technologies. It specifically mentions the use of pre-tests to tailor training and post-tests to ensure that learning has occurred to a standard. However, other than these recommendations, the ALM does not address how assessments should be designed, delivered, and otherwise used to maximize Soldier training. Questions regarding which type of assessment should be used, the optimal frequency of assessment and how to automate assessment in collaborative problem-solving scenarios remain to be answered. To address these issues the U.S. Army Research Institute (ARI) developed prototype training that provides a test-bed for conducting research on assessment strategies with maturing training technologies. This paper discusses the development of the prototype training and assessments, including a discussion of the prototype concept, the instructional design approach used to develop the training and corresponding assessments, and the technology considerations and constraints. The paper also describes the results of a beta test that examined the validity and usability of the training platforms and assessments. It concludes with a discussion of future research, which examines critical questions regarding the design and delivery of assessments within the prototype training.