AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance

Public sector use of AI has been quietly on the rise for the past decade, but only recently have efforts to regulate it entered the cultural zeitgeist. While simple to articulate, promoting ethical and effective roll outs of AI systems in government is a notoriously elusive task. On the one hand the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Zick, Tom, Kortz, Mason, Eaves, David, Doshi-Velez, Finale
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Zick, Tom
Kortz, Mason
Eaves, David
Doshi-Velez, Finale
description Public sector use of AI has been quietly on the rise for the past decade, but only recently have efforts to regulate it entered the cultural zeitgeist. While simple to articulate, promoting ethical and effective roll outs of AI systems in government is a notoriously elusive task. On the one hand there are hard-to-address pitfalls associated with AI-based tools, including concerns about bias towards marginalized communities, safety, and gameability. On the other, there is pressure not to make it too difficult to adopt AI, especially in the public sector which typically has fewer resources than the private sector$\unicode{x2014}$conserving scarce government resources is often the draw of using AI-based tools in the first place. These tensions create a real risk that procedures built to ensure marginalized groups are not hurt by government use of AI will, in practice, be performative and ineffective. To inform the latest wave of regulatory efforts in the United States, we look to jurisdictions with mature regulations around government AI use. We report on lessons learned by officials in Brazil, Singapore and Canada, who have collectively implemented risk categories, disclosure requirements and assessments into the way they procure AI tools. In particular, we investigate two implemented checklists: the Canadian Directive on Automated Decision-Making (CDADM) and the World Economic Forum's AI Procurement in a Box (WEF). We detail three key pitfalls around expertise, risk frameworks and transparency, that can decrease the efficacy of regulations aimed at government AI use and suggest avenues for improvement.
doi_str_mv 10.48550/arxiv.2404.14660
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2404_14660</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2404_14660</sourcerecordid><originalsourceid>FETCH-LOGICAL-a670-8c530b1aca4725c6af48f9dfea351a0a6362bf0b7904da04be00c3e2c638b02e3</originalsourceid><addsrcrecordid>eNotz7FOwzAUhWEvDKjwAEz4BRJubMdJu0URlEiVqFD36Ma9bq0mTuWYCN4eCExnOfqlj7GHDFJV5jk8Yfh0cyoUqDRTWsMt21cN34fRfAQayEden8lcejfFacPfaXaTi86feDNc--WA0Y2eO8_jmXh1Ij5a_pPYjjMFj97QHbux2E90_78rdnh5PtSvye5t29TVLkFdQFKaXEKXoUFViNxotKq066MllHmGgFpq0VnoijWoI4LqCMBIEkbLsgNBcsUe_7ILqb0GN2D4an9p7UKT3wEhSU4</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance</title><source>arXiv.org</source><creator>Zick, Tom ; Kortz, Mason ; Eaves, David ; Doshi-Velez, Finale</creator><creatorcontrib>Zick, Tom ; Kortz, Mason ; Eaves, David ; Doshi-Velez, Finale</creatorcontrib><description>Public sector use of AI has been quietly on the rise for the past decade, but only recently have efforts to regulate it entered the cultural zeitgeist. While simple to articulate, promoting ethical and effective roll outs of AI systems in government is a notoriously elusive task. On the one hand there are hard-to-address pitfalls associated with AI-based tools, including concerns about bias towards marginalized communities, safety, and gameability. On the other, there is pressure not to make it too difficult to adopt AI, especially in the public sector which typically has fewer resources than the private sector$\unicode{x2014}$conserving scarce government resources is often the draw of using AI-based tools in the first place. These tensions create a real risk that procedures built to ensure marginalized groups are not hurt by government use of AI will, in practice, be performative and ineffective. To inform the latest wave of regulatory efforts in the United States, we look to jurisdictions with mature regulations around government AI use. We report on lessons learned by officials in Brazil, Singapore and Canada, who have collectively implemented risk categories, disclosure requirements and assessments into the way they procure AI tools. In particular, we investigate two implemented checklists: the Canadian Directive on Automated Decision-Making (CDADM) and the World Economic Forum's AI Procurement in a Box (WEF). We detail three key pitfalls around expertise, risk frameworks and transparency, that can decrease the efficacy of regulations aimed at government AI use and suggest avenues for improvement.</description><identifier>DOI: 10.48550/arxiv.2404.14660</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computers and Society</subject><creationdate>2024-04</creationdate><rights>http://creativecommons.org/licenses/by/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2404.14660$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2404.14660$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Zick, Tom</creatorcontrib><creatorcontrib>Kortz, Mason</creatorcontrib><creatorcontrib>Eaves, David</creatorcontrib><creatorcontrib>Doshi-Velez, Finale</creatorcontrib><title>AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance</title><description>Public sector use of AI has been quietly on the rise for the past decade, but only recently have efforts to regulate it entered the cultural zeitgeist. While simple to articulate, promoting ethical and effective roll outs of AI systems in government is a notoriously elusive task. On the one hand there are hard-to-address pitfalls associated with AI-based tools, including concerns about bias towards marginalized communities, safety, and gameability. On the other, there is pressure not to make it too difficult to adopt AI, especially in the public sector which typically has fewer resources than the private sector$\unicode{x2014}$conserving scarce government resources is often the draw of using AI-based tools in the first place. These tensions create a real risk that procedures built to ensure marginalized groups are not hurt by government use of AI will, in practice, be performative and ineffective. To inform the latest wave of regulatory efforts in the United States, we look to jurisdictions with mature regulations around government AI use. We report on lessons learned by officials in Brazil, Singapore and Canada, who have collectively implemented risk categories, disclosure requirements and assessments into the way they procure AI tools. In particular, we investigate two implemented checklists: the Canadian Directive on Automated Decision-Making (CDADM) and the World Economic Forum's AI Procurement in a Box (WEF). We detail three key pitfalls around expertise, risk frameworks and transparency, that can decrease the efficacy of regulations aimed at government AI use and suggest avenues for improvement.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computers and Society</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotz7FOwzAUhWEvDKjwAEz4BRJubMdJu0URlEiVqFD36Ma9bq0mTuWYCN4eCExnOfqlj7GHDFJV5jk8Yfh0cyoUqDRTWsMt21cN34fRfAQayEden8lcejfFacPfaXaTi86feDNc--WA0Y2eO8_jmXh1Ij5a_pPYjjMFj97QHbux2E90_78rdnh5PtSvye5t29TVLkFdQFKaXEKXoUFViNxotKq066MllHmGgFpq0VnoijWoI4LqCMBIEkbLsgNBcsUe_7ILqb0GN2D4an9p7UKT3wEhSU4</recordid><startdate>20240422</startdate><enddate>20240422</enddate><creator>Zick, Tom</creator><creator>Kortz, Mason</creator><creator>Eaves, David</creator><creator>Doshi-Velez, Finale</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20240422</creationdate><title>AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance</title><author>Zick, Tom ; Kortz, Mason ; Eaves, David ; Doshi-Velez, Finale</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a670-8c530b1aca4725c6af48f9dfea351a0a6362bf0b7904da04be00c3e2c638b02e3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computers and Society</topic><toplevel>online_resources</toplevel><creatorcontrib>Zick, Tom</creatorcontrib><creatorcontrib>Kortz, Mason</creatorcontrib><creatorcontrib>Eaves, David</creatorcontrib><creatorcontrib>Doshi-Velez, Finale</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Zick, Tom</au><au>Kortz, Mason</au><au>Eaves, David</au><au>Doshi-Velez, Finale</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance</atitle><date>2024-04-22</date><risdate>2024</risdate><abstract>Public sector use of AI has been quietly on the rise for the past decade, but only recently have efforts to regulate it entered the cultural zeitgeist. While simple to articulate, promoting ethical and effective roll outs of AI systems in government is a notoriously elusive task. On the one hand there are hard-to-address pitfalls associated with AI-based tools, including concerns about bias towards marginalized communities, safety, and gameability. On the other, there is pressure not to make it too difficult to adopt AI, especially in the public sector which typically has fewer resources than the private sector$\unicode{x2014}$conserving scarce government resources is often the draw of using AI-based tools in the first place. These tensions create a real risk that procedures built to ensure marginalized groups are not hurt by government use of AI will, in practice, be performative and ineffective. To inform the latest wave of regulatory efforts in the United States, we look to jurisdictions with mature regulations around government AI use. We report on lessons learned by officials in Brazil, Singapore and Canada, who have collectively implemented risk categories, disclosure requirements and assessments into the way they procure AI tools. In particular, we investigate two implemented checklists: the Canadian Directive on Automated Decision-Making (CDADM) and the World Economic Forum's AI Procurement in a Box (WEF). We detail three key pitfalls around expertise, risk frameworks and transparency, that can decrease the efficacy of regulations aimed at government AI use and suggest avenues for improvement.</abstract><doi>10.48550/arxiv.2404.14660</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2404.14660
ispartof
issn
language eng
recordid cdi_arxiv_primary_2404_14660
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computers and Society
title AI Procurement Checklists: Revisiting Implementation in the Age of AI Governance
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T14%3A30%3A06IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=AI%20Procurement%20Checklists:%20Revisiting%20Implementation%20in%20the%20Age%20of%20AI%20Governance&rft.au=Zick,%20Tom&rft.date=2024-04-22&rft_id=info:doi/10.48550/arxiv.2404.14660&rft_dat=%3Carxiv_GOX%3E2404_14660%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true