Development of American Society for Gastrointestinal Endoscopy standards for training in advanced endoscopy within dedicated advanced endoscopy fellowship programs

Training in interventional endoscopy is offered by nonaccredited advanced endoscopy fellowship programs (AEFPs). The number of these programs has increased dramatically with a concurrent increase in the breadth and complexity of interventional endoscopy procedures. Accreditation is governed by competency-based education, yet what constitutes a “high-quality” nonaccredited AEFP has not been defined. Using an evidence-based consensus process, we aimed to establish standards for AEFPs. The RAND UCLA appropriateness method, a well-described modified Delphi process to develop quality indicators, was used. A task force established by the American Society for Gastrointestinal Endoscopy drafted potential quality indicators (structure, process, and outcome) in 6 categories: activity preceding training; structure of AEFPs; training in ERCP, EUS, and EMR; and luminal stent placement. Three rounds of iterative feedback from 20 experts were conducted. Round 0 involved discussion of project details. In round 1, experts independently ranked proposed quality indicators on a 9-point interval scale ranging from highly inappropriate (1) to highly appropriate (9). Next, proposed quality indicators were discussed and reworded in a group meeting followed by round 2, in which experts independently reranked proposed quality indicators and provided benchmarks (when applicable). The median score for each quality indicator was calculated. Mean absolute deviation from the median was calculated, and appropriateness of potential quality indicators was assessed using the BIOMED concerted action on appropriateness definition, P value method, and interpercentile range adjusted for symmetry definition. A quality indicator was deemed appropriate if the median score was ≥7 and met criteria for appropriateness using all 3 defined statistical methods. Of 89 proposed quality indicators, 37 statements met criteria as appropriate for a quality indicator (activity preceding training, 2; structure of AEFPs, 10; training in ERCP, 7; training in EUS, 8; training in EMR, 7; luminal stent placement, 3). Minimum thresholds were defined for 19 relevant quality indicators for number of trainers, procedures during fellowship, and procedures before assessment of competence. Among the final appropriate quality indicators were that all trainees should undergo qualitative and quantitative competence assessments using validated tools at least quarterly with documented feedback throughout the training period and