A dataset of clinically generated visual questions and answers about radiology images
Radiology images are an essential part of clinical decision making and population screening, e.g., for cancer. Automated systems could help clinicians cope with large amounts of images by answering questions about the image contents. An emerging area of artificial intelligence, Visual Question Answe...
Gespeichert in:
Veröffentlicht in: | Scientific data 2018-11, Vol.5 (1), p.180251-10, Article 180251 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | Radiology images are an essential part of clinical decision making and population screening, e.g., for cancer. Automated systems could help clinicians cope with large amounts of images by answering questions about the image contents. An emerging area of artificial intelligence, Visual Question Answering (VQA) in the medical domain explores approaches to this form of clinical decision support. Success of such machine learning tools hinges on availability and design of collections composed of medical images augmented with question-answer pairs directed at the content of the image. We introduce VQA-RAD, the first manually constructed dataset where clinicians asked naturally occurring questions about radiology images and provided reference answers. Manual categorization of images and questions provides insight into clinically relevant tasks and the natural language to phrase them. Evaluating with well-known algorithms, we demonstrate the rich quality of this dataset over other automatically constructed ones. We propose VQA-RAD to encourage the community to design VQA tools with the goals of improving patient care.
Design Type(s)
image creation and editing objective • anatomical image analysis objective
Measurement Type(s)
image analysis
Technology Type(s)
visual observation method
Factor Type(s)
question type • answer type
Sample Characteristic(s)
Homo sapiens • head • chest • abdomen
Machine-accessible metadata file describing the reported data
(ISA-Tab format) |
---|---|
ISSN: | 2052-4463 2052-4463 |
DOI: | 10.1038/sdata.2018.251 |