SYSTEM AND METHOD FOR CALCULATING ACCURATE GROUND TRUTH RATES FROM UNRELIABLE SOURCES
Described are techniques for determining an accurate ground-truth Bayesian Inter-Reviewer Agreement Rate (BIRAR) from unreliable sources. For instance, a process can include obtaining an initial set of diagnostic imaging exams, wherein each diagnostic imaging exam includes a severity grade associate...
Gespeichert in:
Hauptverfasser: | , , , , , , , , |
---|---|
Format: | Patent |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Described are techniques for determining an accurate ground-truth Bayesian Inter-Reviewer Agreement Rate (BIRAR) from unreliable sources. For instance, a process can include obtaining an initial set of diagnostic imaging exams, wherein each diagnostic imaging exam includes a severity grade associated with an initial radiologist. For each diagnostic imaging exam, two or more secondary quality assurance (QA) reviews can be obtained for each diagnostic imaging exam, wherein the secondary QA reviews are associated with QA'ing radiologists different than the initial radiologist. One or more inter-reviewer agreement rates can be determined for the QA'ing radiologists, based on the secondary QA reviews associated with the QA'ing radiologists. A diagnostic error associated with one or more initial radiologists can be determined based at least in part on the one or more inter-reviewer agreement rates for the QA'ing radiologists and a subsequent diagnostic imaging exam obtained for a respective one of the initial radiologists. |
---|