Techniques for Evaluating Distance Learning Events

This paper describes techniques for creating a simplified form for evaluating the effectiveness of a distance learning event (i.e., a training or educational program occurring within 1 day) for which the development of comprehensive measures is often not feasible because the brevity of the event precludes the justification for a lengthy evaluation. The paper focuses on distance learning events for the National Guard Bureau. Background is provided on evaluation measures, including student reaction, learning, behavioral criteria, and results criteria. Development of the compressed evaluation form--one page of five assessment categories (course, technology, instructor, demographics, and motivation) with a total of 22 items--is discussed. Testing of the compressed evaluation form is described. Eight distance learning events were sampled, representing the primary distance learning events available on a nation-wide basis during the evaluation time frame. Training was delivered through a multi-point, one-way video, two-way audio connection through satellite links. A total of 1,306 soldiers participated in the training; the mean rate of returned evaluations was 74%. Two tables present data on student ratings of events and cross tabulation of amount learned by previous training. It is concluded that a wealth of information can be obtained from a simple, one-page evaluation form. (DLS)