"False negative - that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing
The demand for automated security analysis techniques, such as static analysis based security testing (SAST) tools continues to increase. To develop SASTs that are effectively leveraged by developers for finding vulnerabilities, researchers and tool designers must understand how developers perceive,...
Gespeichert in:
Hauptverfasser: | , , , |
---|---|
Format: | Tagungsbericht |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 3997 |
---|---|
container_issue | |
container_start_page | 3979 |
container_title | |
container_volume | |
creator | Ami, Amit Seal Moran, Kevin Poshyvanyk, Denys Nadkarni, Adwait |
description | The demand for automated security analysis techniques, such as static analysis based security testing (SAST) tools continues to increase. To develop SASTs that are effectively leveraged by developers for finding vulnerabilities, researchers and tool designers must understand how developers perceive, select, and use SASTs, what they expect from the tools, whether they know of the limitations of the tools, and how they address those limitations. This paper describes a qualitative study that explores the assumptions, expectations, beliefs, and challenges experienced by developers who use SASTs. We perform in-depth, semi-structured interviews with 20 practitioners who possess a diverse range of software development expertise, as well as a variety of unique security, product, and organizational backgrounds. We identify 17 key findings that shed light on developer perceptions and desires related to SASTs, and also expose gaps in the status quo - challenging long-held beliefs in SAST design priorities. Finally, we provide concrete future directions for researchers and practitioners rooted in an analysis of our findings. |
doi_str_mv | 10.1109/SP54263.2024.00019 |
format | Conference Proceeding |
fullrecord | <record><control><sourceid>ieee_RIE</sourceid><recordid>TN_cdi_ieee_primary_10646636</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>10646636</ieee_id><sourcerecordid>10646636</sourcerecordid><originalsourceid>FETCH-LOGICAL-i150t-c5b2435024843fac4f1ecc9f8a4ae3b1086c2fdd4e62d31ec8037a55a03f8c5d3</originalsourceid><addsrcrecordid>eNotj01Lw0AYhFdBsNb-AfHw0nvqu1_58FaK1ULBQttz2e6-qasxKdmtkFP_uil6GphhHmYYe-A44RyLp_VKK5HKiUChJojIiys2KrIilxql5BL5NRsImemEC8xu2V0In4gCZaEG7DyemyoQ1HQw0f8QJBA_TISmJvABDo2vDxAb-PJVBV1zGj_DtnbUhmhqd8kWtTuF2Haw6s0j2QskQFPCOvZAC9PaVF3oUXsTyMGa7Kn1sYMNhdj379lNeRkw-tch285fNrO3ZPn-uphNl4nnGmNi9V6o_o9QuZKlsarkZG1R5kYZknuOeWpF6ZyiVDjZZznKzGhtUJa51U4O2eMf1xPR7tj6b9N2O46pSlOZyl_EdmC1</addsrcrecordid><sourcetype>Publisher</sourcetype><iscdi>true</iscdi><recordtype>conference_proceeding</recordtype></control><display><type>conference_proceeding</type><title>"False negative - that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing</title><source>IEEE Electronic Library (IEL)</source><creator>Ami, Amit Seal ; Moran, Kevin ; Poshyvanyk, Denys ; Nadkarni, Adwait</creator><creatorcontrib>Ami, Amit Seal ; Moran, Kevin ; Poshyvanyk, Denys ; Nadkarni, Adwait</creatorcontrib><description>The demand for automated security analysis techniques, such as static analysis based security testing (SAST) tools continues to increase. To develop SASTs that are effectively leveraged by developers for finding vulnerabilities, researchers and tool designers must understand how developers perceive, select, and use SASTs, what they expect from the tools, whether they know of the limitations of the tools, and how they address those limitations. This paper describes a qualitative study that explores the assumptions, expectations, beliefs, and challenges experienced by developers who use SASTs. We perform in-depth, semi-structured interviews with 20 practitioners who possess a diverse range of software development expertise, as well as a variety of unique security, product, and organizational backgrounds. We identify 17 key findings that shed light on developer perceptions and desires related to SASTs, and also expose gaps in the status quo - challenging long-held beliefs in SAST design priorities. Finally, we provide concrete future directions for researchers and practitioners rooted in an analysis of our findings.</description><identifier>EISSN: 2375-1207</identifier><identifier>EISBN: 9798350331301</identifier><identifier>DOI: 10.1109/SP54263.2024.00019</identifier><identifier>CODEN: IEEPAD</identifier><language>eng</language><publisher>IEEE</publisher><subject>Benchmark testing ; false negative ; false positive ; Industries ; Privacy ; Protocols ; qualitative research ; Reliability ; SAST ; Security ; software engineering ; software security ; Static analysis ; static analysis based security testing ; thematic analysis</subject><ispartof>2024 IEEE Symposium on Security and Privacy (SP), 2024, p.3979-3997</ispartof><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/10646636$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>309,310,780,784,789,790,796,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/10646636$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Ami, Amit Seal</creatorcontrib><creatorcontrib>Moran, Kevin</creatorcontrib><creatorcontrib>Poshyvanyk, Denys</creatorcontrib><creatorcontrib>Nadkarni, Adwait</creatorcontrib><title>"False negative - that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing</title><title>2024 IEEE Symposium on Security and Privacy (SP)</title><addtitle>SP</addtitle><description>The demand for automated security analysis techniques, such as static analysis based security testing (SAST) tools continues to increase. To develop SASTs that are effectively leveraged by developers for finding vulnerabilities, researchers and tool designers must understand how developers perceive, select, and use SASTs, what they expect from the tools, whether they know of the limitations of the tools, and how they address those limitations. This paper describes a qualitative study that explores the assumptions, expectations, beliefs, and challenges experienced by developers who use SASTs. We perform in-depth, semi-structured interviews with 20 practitioners who possess a diverse range of software development expertise, as well as a variety of unique security, product, and organizational backgrounds. We identify 17 key findings that shed light on developer perceptions and desires related to SASTs, and also expose gaps in the status quo - challenging long-held beliefs in SAST design priorities. Finally, we provide concrete future directions for researchers and practitioners rooted in an analysis of our findings.</description><subject>Benchmark testing</subject><subject>false negative</subject><subject>false positive</subject><subject>Industries</subject><subject>Privacy</subject><subject>Protocols</subject><subject>qualitative research</subject><subject>Reliability</subject><subject>SAST</subject><subject>Security</subject><subject>software engineering</subject><subject>software security</subject><subject>Static analysis</subject><subject>static analysis based security testing</subject><subject>thematic analysis</subject><issn>2375-1207</issn><isbn>9798350331301</isbn><fulltext>true</fulltext><rsrctype>conference_proceeding</rsrctype><creationdate>2024</creationdate><recordtype>conference_proceeding</recordtype><sourceid>6IE</sourceid><sourceid>RIE</sourceid><recordid>eNotj01Lw0AYhFdBsNb-AfHw0nvqu1_58FaK1ULBQttz2e6-qasxKdmtkFP_uil6GphhHmYYe-A44RyLp_VKK5HKiUChJojIiys2KrIilxql5BL5NRsImemEC8xu2V0In4gCZaEG7DyemyoQ1HQw0f8QJBA_TISmJvABDo2vDxAb-PJVBV1zGj_DtnbUhmhqd8kWtTuF2Haw6s0j2QskQFPCOvZAC9PaVF3oUXsTyMGa7Kn1sYMNhdj379lNeRkw-tch285fNrO3ZPn-uphNl4nnGmNi9V6o_o9QuZKlsarkZG1R5kYZknuOeWpF6ZyiVDjZZznKzGhtUJa51U4O2eMf1xPR7tj6b9N2O46pSlOZyl_EdmC1</recordid><startdate>20240519</startdate><enddate>20240519</enddate><creator>Ami, Amit Seal</creator><creator>Moran, Kevin</creator><creator>Poshyvanyk, Denys</creator><creator>Nadkarni, Adwait</creator><general>IEEE</general><scope>6IE</scope><scope>6IH</scope><scope>CBEJK</scope><scope>RIE</scope><scope>RIO</scope></search><sort><creationdate>20240519</creationdate><title>"False negative - that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing</title><author>Ami, Amit Seal ; Moran, Kevin ; Poshyvanyk, Denys ; Nadkarni, Adwait</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-i150t-c5b2435024843fac4f1ecc9f8a4ae3b1086c2fdd4e62d31ec8037a55a03f8c5d3</frbrgroupid><rsrctype>conference_proceedings</rsrctype><prefilter>conference_proceedings</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Benchmark testing</topic><topic>false negative</topic><topic>false positive</topic><topic>Industries</topic><topic>Privacy</topic><topic>Protocols</topic><topic>qualitative research</topic><topic>Reliability</topic><topic>SAST</topic><topic>Security</topic><topic>software engineering</topic><topic>software security</topic><topic>Static analysis</topic><topic>static analysis based security testing</topic><topic>thematic analysis</topic><toplevel>online_resources</toplevel><creatorcontrib>Ami, Amit Seal</creatorcontrib><creatorcontrib>Moran, Kevin</creatorcontrib><creatorcontrib>Poshyvanyk, Denys</creatorcontrib><creatorcontrib>Nadkarni, Adwait</creatorcontrib><collection>IEEE Electronic Library (IEL) Conference Proceedings</collection><collection>IEEE Proceedings Order Plan (POP) 1998-present by volume</collection><collection>IEEE Xplore All Conference Proceedings</collection><collection>IEEE Electronic Library (IEL)</collection><collection>IEEE Proceedings Order Plans (POP) 1998-present</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ami, Amit Seal</au><au>Moran, Kevin</au><au>Poshyvanyk, Denys</au><au>Nadkarni, Adwait</au><format>book</format><genre>proceeding</genre><ristype>CONF</ristype><atitle>"False negative - that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing</atitle><btitle>2024 IEEE Symposium on Security and Privacy (SP)</btitle><stitle>SP</stitle><date>2024-05-19</date><risdate>2024</risdate><spage>3979</spage><epage>3997</epage><pages>3979-3997</pages><eissn>2375-1207</eissn><eisbn>9798350331301</eisbn><coden>IEEPAD</coden><abstract>The demand for automated security analysis techniques, such as static analysis based security testing (SAST) tools continues to increase. To develop SASTs that are effectively leveraged by developers for finding vulnerabilities, researchers and tool designers must understand how developers perceive, select, and use SASTs, what they expect from the tools, whether they know of the limitations of the tools, and how they address those limitations. This paper describes a qualitative study that explores the assumptions, expectations, beliefs, and challenges experienced by developers who use SASTs. We perform in-depth, semi-structured interviews with 20 practitioners who possess a diverse range of software development expertise, as well as a variety of unique security, product, and organizational backgrounds. We identify 17 key findings that shed light on developer perceptions and desires related to SASTs, and also expose gaps in the status quo - challenging long-held beliefs in SAST design priorities. Finally, we provide concrete future directions for researchers and practitioners rooted in an analysis of our findings.</abstract><pub>IEEE</pub><doi>10.1109/SP54263.2024.00019</doi><tpages>19</tpages><oa>free_for_read</oa></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | EISSN: 2375-1207 |
ispartof | 2024 IEEE Symposium on Security and Privacy (SP), 2024, p.3979-3997 |
issn | 2375-1207 |
language | eng |
recordid | cdi_ieee_primary_10646636 |
source | IEEE Electronic Library (IEL) |
subjects | Benchmark testing false negative false positive Industries Privacy Protocols qualitative research Reliability SAST Security software engineering software security Static analysis static analysis based security testing thematic analysis |
title | "False negative - that one is going to kill you": Understanding Industry Perspectives of Static Analysis based Security Testing |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T11%3A01%3A04IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-ieee_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:book&rft.genre=proceeding&rft.atitle=%22False%20negative%20-%20that%20one%20is%20going%20to%20kill%20you%22:%20Understanding%20Industry%20Perspectives%20of%20Static%20Analysis%20based%20Security%20Testing&rft.btitle=2024%20IEEE%20Symposium%20on%20Security%20and%20Privacy%20(SP)&rft.au=Ami,%20Amit%20Seal&rft.date=2024-05-19&rft.spage=3979&rft.epage=3997&rft.pages=3979-3997&rft.eissn=2375-1207&rft.coden=IEEPAD&rft_id=info:doi/10.1109/SP54263.2024.00019&rft_dat=%3Cieee_RIE%3E10646636%3C/ieee_RIE%3E%3Curl%3E%3C/url%3E&rft.eisbn=9798350331301&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=10646636&rfr_iscdi=true |