Towards evaluating and eliciting high-quality documentation for intelligent systems
A vital component of trust and transparency in intelligent systems built on machine learning and artificial intelligence is the development of clear, understandable documentation. However, such systems are notorious for their complexity and opaqueness making quality documentation a non-trivial task....
Gespeichert in:
| Hauptverfasser: | , , , |
|---|---|
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | |
|---|---|
| container_issue | |
| container_start_page | |
| container_title | |
| container_volume | |
| creator | Piorkowski, David González, Daniel Richards, John Houde, Stephanie |
| description | A vital component of trust and transparency in intelligent systems built on
machine learning and artificial intelligence is the development of clear,
understandable documentation. However, such systems are notorious for their
complexity and opaqueness making quality documentation a non-trivial task.
Furthermore, little is known about what makes such documentation "good." In
this paper, we propose and evaluate a set of quality dimensions to identify in
what ways this type of documentation falls short. Then, using those dimensions,
we evaluate three different approaches for eliciting intelligent system
documentation. We show how the dimensions identify shortcomings in such
documentation and posit how such dimensions can be use to further enable users
to provide documentation that is suitable to a given persona or use case. |
| doi_str_mv | 10.48550/arxiv.2011.08774 |
| format | Article |
| fullrecord | <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2011_08774</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2011_08774</sourcerecordid><originalsourceid>FETCH-LOGICAL-a674-dd2fd25b7ad9da8e49cb2a5cbb09019124e5e81e93e96c8289bbab300e42fdd13</originalsourceid><addsrcrecordid>eNotj89OhDAYxHvxYFYfwJN9AbAtZWmPZuO_ZBMPy518pR9sk1K0lFXeXkRPk5nMTPIj5I6zXKqyZA8Qv90lF4zznKmqktfkVI9fEO1E8QJ-huRCTyFYit61bnNn15-zzxm8Swu1YzsPGNJaHAPtxkhdSOi969eQTsuUcJhuyFUHfsLbf92R-vmpPrxmx_eXt8PjMYN9JTNrRWdFaSqw2oJCqVsjoGyNYZpxzYXEEhVHXaDet0oobQyYgjGU69DyYkfu_243quYjugHi0vzSNRtd8QOUbU0P</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Towards evaluating and eliciting high-quality documentation for intelligent systems</title><source>arXiv.org</source><creator>Piorkowski, David ; González, Daniel ; Richards, John ; Houde, Stephanie</creator><creatorcontrib>Piorkowski, David ; González, Daniel ; Richards, John ; Houde, Stephanie</creatorcontrib><description>A vital component of trust and transparency in intelligent systems built on
machine learning and artificial intelligence is the development of clear,
understandable documentation. However, such systems are notorious for their
complexity and opaqueness making quality documentation a non-trivial task.
Furthermore, little is known about what makes such documentation "good." In
this paper, we propose and evaluate a set of quality dimensions to identify in
what ways this type of documentation falls short. Then, using those dimensions,
we evaluate three different approaches for eliciting intelligent system
documentation. We show how the dimensions identify shortcomings in such
documentation and posit how such dimensions can be use to further enable users
to provide documentation that is suitable to a given persona or use case.</description><identifier>DOI: 10.48550/arxiv.2011.08774</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Software Engineering</subject><creationdate>2020-11</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,777,882</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2011.08774$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2011.08774$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Piorkowski, David</creatorcontrib><creatorcontrib>González, Daniel</creatorcontrib><creatorcontrib>Richards, John</creatorcontrib><creatorcontrib>Houde, Stephanie</creatorcontrib><title>Towards evaluating and eliciting high-quality documentation for intelligent systems</title><description>A vital component of trust and transparency in intelligent systems built on
machine learning and artificial intelligence is the development of clear,
understandable documentation. However, such systems are notorious for their
complexity and opaqueness making quality documentation a non-trivial task.
Furthermore, little is known about what makes such documentation "good." In
this paper, we propose and evaluate a set of quality dimensions to identify in
what ways this type of documentation falls short. Then, using those dimensions,
we evaluate three different approaches for eliciting intelligent system
documentation. We show how the dimensions identify shortcomings in such
documentation and posit how such dimensions can be use to further enable users
to provide documentation that is suitable to a given persona or use case.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Software Engineering</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj89OhDAYxHvxYFYfwJN9AbAtZWmPZuO_ZBMPy518pR9sk1K0lFXeXkRPk5nMTPIj5I6zXKqyZA8Qv90lF4zznKmqktfkVI9fEO1E8QJ-huRCTyFYit61bnNn15-zzxm8Swu1YzsPGNJaHAPtxkhdSOi969eQTsuUcJhuyFUHfsLbf92R-vmpPrxmx_eXt8PjMYN9JTNrRWdFaSqw2oJCqVsjoGyNYZpxzYXEEhVHXaDet0oobQyYgjGU69DyYkfu_243quYjugHi0vzSNRtd8QOUbU0P</recordid><startdate>20201117</startdate><enddate>20201117</enddate><creator>Piorkowski, David</creator><creator>González, Daniel</creator><creator>Richards, John</creator><creator>Houde, Stephanie</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20201117</creationdate><title>Towards evaluating and eliciting high-quality documentation for intelligent systems</title><author>Piorkowski, David ; González, Daniel ; Richards, John ; Houde, Stephanie</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a674-dd2fd25b7ad9da8e49cb2a5cbb09019124e5e81e93e96c8289bbab300e42fdd13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Software Engineering</topic><toplevel>online_resources</toplevel><creatorcontrib>Piorkowski, David</creatorcontrib><creatorcontrib>González, Daniel</creatorcontrib><creatorcontrib>Richards, John</creatorcontrib><creatorcontrib>Houde, Stephanie</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Piorkowski, David</au><au>González, Daniel</au><au>Richards, John</au><au>Houde, Stephanie</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Towards evaluating and eliciting high-quality documentation for intelligent systems</atitle><date>2020-11-17</date><risdate>2020</risdate><abstract>A vital component of trust and transparency in intelligent systems built on
machine learning and artificial intelligence is the development of clear,
understandable documentation. However, such systems are notorious for their
complexity and opaqueness making quality documentation a non-trivial task.
Furthermore, little is known about what makes such documentation "good." In
this paper, we propose and evaluate a set of quality dimensions to identify in
what ways this type of documentation falls short. Then, using those dimensions,
we evaluate three different approaches for eliciting intelligent system
documentation. We show how the dimensions identify shortcomings in such
documentation and posit how such dimensions can be use to further enable users
to provide documentation that is suitable to a given persona or use case.</abstract><doi>10.48550/arxiv.2011.08774</doi><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | DOI: 10.48550/arxiv.2011.08774 |
| ispartof | |
| issn | |
| language | eng |
| recordid | cdi_arxiv_primary_2011_08774 |
| source | arXiv.org |
| subjects | Computer Science - Artificial Intelligence Computer Science - Software Engineering |
| title | Towards evaluating and eliciting high-quality documentation for intelligent systems |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-18T12%3A28%3A42IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Towards%20evaluating%20and%20eliciting%20high-quality%20documentation%20for%20intelligent%20systems&rft.au=Piorkowski,%20David&rft.date=2020-11-17&rft_id=info:doi/10.48550/arxiv.2011.08774&rft_dat=%3Carxiv_GOX%3E2011_08774%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true |