ELIXR: Towards a general purpose X-ray artificial intelligence system through alignment of large language models and radiology vision encoders

In this work, we present an approach, which we call Embeddings for Language/Image-aligned X-Rays, or ELIXR, that leverages a language-aligned image encoder combined or grafted onto a fixed LLM, PaLM 2, to perform a broad range of chest X-ray tasks. We train this lightweight adapter architecture usin...

Ausführliche Beschreibung

Bibliographische Detailangaben

Hauptverfasser:	Xu, Shawn, Yang, Lin, Kelly, Christopher, Sieniek, Marcin, Kohlberger, Timo, Ma, Martin, Weng, Wei-Hung, Kiraly, Atilla, Kazemzadeh, Sahar, Melamed, Zakkai, Park, Jungyeon, Strachan, Patricia, Liu, Yun, Lau, Chuck, Singh, Preeti, Chen, Christina, Etemadi, Mozziyar, Kalidindi, Sreenivasa Raju, Matias, Yossi, Chou, Katherine, Corrado, Greg S, Shetty, Shravya, Tse, Daniel, Prabhakara, Shruthi, Golden, Daniel, Pilgrim, Rory, Eswaran, Krish, Sellergren, Andrew
Format:	Artikel
Sprache:	eng
Schlagworte:	Computer Science - Computer Vision and Pattern Recognition
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!