Trust but Verify: Programmatic VLM Evaluation in the Wild

Vision-Language Models (VLMs) often generate plausible but incorrect responses to visual queries. However, reliably quantifying the effect of such hallucinations in free-form responses to open-ended queries is challenging as it requires visually verifying each claim within the response. We propose P...

Ausführliche Beschreibung

Bibliographische Detailangaben

Veröffentlicht in:	arXiv.org 2024-10
Hauptverfasser:	Prabhu, Viraj, Purushwalkam, Senthil, An, Yan, Xiong, Caiming, Xu, Ran
Format:	Artikel
Sprache:	eng
Schlagworte:	Benchmarks Free form Graph representations Graphical representations Large language models Queries Visual effects
Online-Zugang:	Volltext
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!