Evaluation Guidelines for Multimedia Courseware

This research sought to identify criteria important to multimedia instructional courseware evaluation and validate them with a panel of instructional technology experts. Data were collected with a Web-based survey using a modified Delphi research technique. During three rounds of questioning, experts judged 91 criteria as important to the evaluation of instructional courseware. The study also examined the effect of conducting panel discussions online. The method of panel discussion presented in the study enabled geographically dispersed discussants to examine criteria collectively. Although limited, participant commentary helped refine the criteria list. In general, participants agreed in their opinions and gave consistent criteria ratings.