Approaching expert results using a hierarchical cerebellum parcellation protocol for multiple inexpert human raters

Volumetric measurements obtained from image parcellation have been instrumental in uncovering structure–function relationships. However, anatomical study of the cerebellum is a challenging task. Because of its complex structure, expert human raters have been necessary for reliable and accurate segmentation and parcellation. Such delineations are time-consuming and prohibitively expensive for large studies. Therefore, we present a three-part cerebellar parcellation system that utilizes multiple inexpert human raters that can efficiently and expediently produce results nearly on par with those of experts. This system includes a hierarchical delineation protocol, a rapid verification and evaluation process, and statistical fusion of the inexpert rater parcellations. The quality of the raters’ and fused parcellations was established by examining their Dice similarity coefficient, region of interest (ROI) volumes, and the intraclass correlation coefficient of region volume. The intra-rater ICC was found to be 0.93 at the finest level of parcellation. ► We present a system for manual delineation of the cerebellum by inexpert raters. ► A hierarchical protocol enables efficient and accurate results from inexperts. ► A "rapid review" step detects large errors. ► Statistical fusion of several parcellations improves robustness and accuracy. ► The quality of the resulting labels approaches that of a human expert.