Expert Consensus to Finalize a Universal Evaluator Rubric to Assess Pharmacy Students’ Patient Communication Skills

Objective. To use an expert consensus-building process to develop a rubric used by multiple evaluator types to assess Doctor of Pharmacy students’ patient communication skills. Methods. Faculty and staff members from six schools and colleges of pharmacy collaborated on a multi-step expert consensus-building process to create the final version of a communication rubric. First, faculty and patient content experts evaluated each item in the rubric for its relevance, criticality, and global comprehensiveness using a five-point Likert scale (0=not at all, 4=to a high extent). Descriptive statistics were used to analyze the resulting data. Faculty members evaluated the results and came to a consensus on the second version of the rubric. A corresponding codebook was developed and refined through a two-phase process. Results. The initial communication rubric was evaluated by 13 expert reviewers. Mean global comprehensiveness on the rubric was 3.83 for faculty experts and 3.5 for patient experts. After evaluating results from the expert consensus-building process, 14 items on the rubric did not change, five items were revised, three items were removed, and two items were added. The second version of the instrument included 20 items in six topic areas. A codebook was finalized to increase scoring consistency for the 20 communication items. Conclusion. Overall, content experts concluded that the rubric had high global comprehensiveness. Collaboration involving faculty members from multiple schools of pharmacy resulted in a 20-item communication rubric and codebook that can be used to increase consistency in scoring student pharmacists’ patient communication skills.