A Multi-Method Approach to Assess Usability and Acceptability: A Case Study of the Patient-Reported Outcomes Measurement System (PROMIS) Workshop

The Patient-Reported Outcomes Measurement System (PROMIS) network, funded as part of the National Institute of Health's roadmap initiative, is in the process of developing a revolutionary computerized adaptive testing system for use in the clinical research community as a standardized method to select and implement patient-reported outcome measures. Soliciting end-user feedback on the system has posed logistical challenges, given the magnitude of the system's scope and the diversity of the target audience and their research needs. This case study presents the application of multiple qualitative methods—participant observation, usability testing, and focus groups—to determine end-users' acceptance of the system and its usability. Findings from these methods highlight the value in using a multifaceted approach to solicit end-user input to software development.