Supervisory Control System for Ship Damage Control: Volume 6 - Experimental Measurement of Situation Assessment

This report develops a methodology for evaluating the degree that a Supervisory Control System for Damage Control (DC-SCS) conveys situation assessment to a human supervisor, who is usually called a Damage Control Assistant (DCA). The first is non-evasive. Based on videotapes of the DC-SCS human-computer interface consoles, a post-session analysis is conducted to determine the extent that the DC-SCS presents the information deemed most relevant to a ship crisis. The second is invasive in that the DCA - whose only source of information on the state of the world is the DC-SCS - is asked questions about state of the ship and the ship crisis. The construct of situation assessment is described and psychometric issues concerning its accurate measurement are raised. Previous research concerning a model for situation assessment is reviewed. The weaknesses of this past research are determined and recommendations for improvements are made. A new model of situation assessment specific to the damage control domain is presented with a methodology for experimentation and validation. Prepared in cooperation with the Beckman Institute, University of Illinois, Urbana, IL 61801.