Do Proposed Quality Measures for Carpal Tunnel Release Reveal Important Quality Gaps and Are They Reliable?

The American Academy of Orthopaedic Surgeons recently proposed quality measures for the initial surgical treatment of carpal tunnel syndrome (CTS). One measure addressed avoidance of adjunctive surgical procedures during carpal tunnel release; and a second measure addressed avoidance of routine use of clinic-based occupational and/or physical therapy (OT/PT) after carpal tunnel release. However, for quality measures to serve their intended purposes, they must be tested in real-world data to establish that gaps in quality exist and that the measures yield reliable performance information. (1) Is there an important quality gap in clinical practice for avoidance of adjunctive surgical procedures during carpal tunnel release? (2) Is there an important quality gap in avoiding routine use of clinic-based occupational and/or physical therapy after carpal tunnel release? (3) Do these two quality measures have adequate beta-binomial signal-to-noise ratio (SNR) and split-sample reliability (SSR)? This retrospective comparative study used a large national private insurance claims database, the 2018 Optum Clinformatics® Data Mart. Ideally, healthcare quality measures are tested within data reflective of the providers and payors to which the measures will be applied. We previously tested these measures in a large public healthcare system and a single academic medical center. In this study, we sought to test the measures in the broader context of patients and providers using private insurance. For both measures, we included the first carpal tunnel release from 28,083 patients performed by one of 7236 surgeons, irrespective of surgical specialty (including, orthopaedic, plastic, neuro-, and general surgery). To calculate surgeon-level descriptive and reliability statistics, analyses were focused on the 66% (18,622 of 28,083) of patients who received their procedure from one of the 24% (1740 of 7236) of surgeons with at least five carpal tunnel releases in the database. No other inclusion/exclusion criteria were applied. To determine whether the measures reveal important gaps in treatment quality (avoidance of adjunctive procedures and routine therapy), we calculated descriptive statistics (median and interquartile range) of the performance distribution stratified by surgeon-level annual volume of carpal tunnel releases in the database (5+, 10+, 15+, 20+, 25+, and 30+). Like the Centers for Medicare & Medicaid Services (CMS), we considered a measure "topped out" if median