Towards User-Focused Research in Training Data Attribution for Human-Centered Explainable AI
While Explainable AI (XAI) aims to make AI understandable and useful to humans, it has been criticised for relying too much on formalism and solutionism, focusing more on mathematical soundness than user needs. We propose an alternative to this bottom-up approach inspired by design thinking: the XAI...
Gespeichert in:
Hauptverfasser: | , , , , |
---|---|
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
Zusammenfassung: | While Explainable AI (XAI) aims to make AI understandable and useful to
humans, it has been criticised for relying too much on formalism and
solutionism, focusing more on mathematical soundness than user needs. We
propose an alternative to this bottom-up approach inspired by design thinking:
the XAI research community should adopt a top-down, user-focused perspective to
ensure user relevance. We illustrate this with a relatively young subfield of
XAI, Training Data Attribution (TDA). With the surge in TDA research and
growing competition, the field risks repeating the same patterns of
solutionism. We conducted a needfinding study with a diverse group of AI
practitioners to identify potential user needs related to TDA. Through
interviews (N=10) and a systematic survey (N=31), we uncovered new TDA tasks
that are currently largely overlooked. We invite the TDA and XAI communities to
consider these novel tasks and improve the user relevance of their research
outcomes. |
---|---|
DOI: | 10.48550/arxiv.2409.16978 |