Verification and validation of operational software: a process and methodology critique

Verification and Validation (V&V) play a crucial role in producing a quality product on time, within budget and within scope. In this article, we examine the effectiveness of the Software Engineering Evaluation System (SEES), a V&V methodology developed by the U.S. Army Software Engineering Directorate. The critique draws on experiences and insights stemming from an application of that methodology to a controlled software development effort. In addition to citing the beneficial activities mandated by the V&V methodology, we also provide a discussion of prescribed (or lacking) activities having an adverse impact on the V&V effort. Recommendations to improve V&V effectiveness are also presented. Although our discussion focuses on V&V activities defined by the Army's methodology, the insights, lessons learned, and suggested improvements are widely applicable to the more generalized approaches to V&V. Copyright © 2004 John Wiley & Sons, Ltd.