A Context-Based Quasi-Experimental Evaluation of a Computer-Supported Product Development System

This paper deals with the design and development of a computer-supported collaborative work (CSCW) system to support product development, and its evaluation using a quasi-experimental approach in an industrial environment. The evaluation compared the performance of eight different subgroups using the CSCW system with their performance using the existing product development system. Task completion time, non-value added (NVA) time, and certain subjective measures were recorded for each of the two systems tested. Despite their minimal experience with the CSCW system, the subgroups took less time to perform five of the eight tasks with the CSCW system than with the existing system. These time savings were primarily a consequence of a substantial reduction in NVA activities. The mean percentage of total task time devoted to NVA activities dropped from 44% with the existing system to 6% with the CSCW system. Users also rated the CSCW system more favorably than the existing system in terms of the subjective measures.