Role of Exercises and Drills in the Evaluation of Public Health in Emergency Response

Public health agencies have been participating in emergency preparedness exercises for many years. A poorly designed or executed exercise, or an unevaluated or inadequately evaluated plan, may do more harm than good if it leads to a false sense of security, and results in poor performance during an actual emergency. At the time this project began, there were no specific standards for the public health aspects of exercises and drills, and no defined criteria for the evaluation of agency performance in public health. The objective of this study was to develop defined criteria for the evaluation of agency performance. A Delphi panel of 26 experts in the field participated in developing criteria to assist in the evaluation of emergency exercise performance, and facilitate measuring improvement over time. Candidate criteria were based on the usual parts of an emergency plan and three other frameworks used elsewhere in public health or emergency response. The response rate from the expert panel for Delphi Round I was 74%, and for Delphi Round II was 55%. This final menu included 46 public health-agency level criteria grouped into nine categories for use in evaluating an emergency drill or exercise at the local public health level. Use of the public health-specific criteria developed through this process will allow for specific assessment and planning for measurable improvement in a health agency over time.