Knowledge based quality analysis of crowdsourced software development platforms
As an emerging and promising approach, crowdsourcing-based software development has become popular in many domains due to the participation of talented pool of developers in the contests, and to promote the ability of requesters (or customers) to choose the ‘wining’ solution with respect to their de...
Gespeichert in:
| Veröffentlicht in: | Computational and mathematical organization theory 2019-06, Vol.25 (2), p.122-131 |
|---|---|
| Hauptverfasser: | , , , , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 131 |
|---|---|
| container_issue | 2 |
| container_start_page | 122 |
| container_title | Computational and mathematical organization theory |
| container_volume | 25 |
| creator | Habib, Asad Hussain, Shahid Khan, Arif Ali Sohail, Muhammad Khalid Ilahi, Manzoor Mufti, Muhammad Rafiq Faisal, Muhammad Imran |
| description | As an emerging and promising approach, crowdsourcing-based software development has become popular in many domains due to the participation of talented pool of developers in the contests, and to promote the ability of requesters (or customers) to choose the ‘wining’ solution with respect to their desired quality levels. However, due to lack of a central mechanism for team formation, continuity in the developer’s work on consecutive tasks and risk of noise in submissions of a contest, there is a gap between the requesters of a domain and their quality concerns related to the adaptation of a crowdsourcing-based software development platform. In order to address concerns and aid requesters, we describe three measures; Quality of Registrant Developers (QRD), Quality of Contest (QC) and Quality of Support (QS) to compute and predict the quality of a crowdsourcing-based platform through historical information on its completed tasks. We evaluate the capacity of the QRD, QC and QS as assessors to predict the quality. Subsequently, we implement a crawler to mine the information of completed development tasks from the TopCoder platform to inspect the proposed measures. The promising results of our QRD, QC, and QS measures suggest to use the proposed measures to the requesters and researchers of other domains such as pharmaceutical research and development, in order to investigate and predict the quality of crowdsourcing-based software development platforms. |
| doi_str_mv | 10.1007/s10588-018-9269-5 |
| format | Article |
| fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2027998076</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2027998076</sourcerecordid><originalsourceid>FETCH-LOGICAL-c348t-2814c5ec563c353ed4eec82886a49e15a630fefb82f575410e1d6ac742c024413</originalsourceid><addsrcrecordid>eNp1kE1LAzEQhoMoWKs_wFvAczSfu8lRil9Y6EXBW0izk9Ky3WyTraX_3pQVPHmaOTzvy8yD0C2j94zS-iEzqrQmlGlieGWIOkMTpmpOjJDVedmFZoQb_XWJrnLeUEpNLegELd67eGihWQFeugwN3u1dux6O2HWuPeZ1xjFgn-KhyXGffAFyDMPBJcANfEMb-y10A-5bN4SYtvkaXQTXZrj5nVP0-fz0MXsl88XL2-xxTryQeiBcM-kVeFUJL5SARgJ4zbWunDTAlKsEDRCWmgdVK8kosKZyvpbcUy4lE1N0N_b2Ke72kAe7KfeVm7PllNfGaFpXhWIjVT7IOUGwfVpvXTpaRu3Jmx292eLNnrxZVTJ8zOTCditIf83_h34A2GVxPA</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2027998076</pqid></control><display><type>article</type><title>Knowledge based quality analysis of crowdsourced software development platforms</title><source>SpringerLink Journals - AutoHoldings</source><creator>Habib, Asad ; Hussain, Shahid ; Khan, Arif Ali ; Sohail, Muhammad Khalid ; Ilahi, Manzoor ; Mufti, Muhammad Rafiq ; Faisal, Muhammad Imran</creator><creatorcontrib>Habib, Asad ; Hussain, Shahid ; Khan, Arif Ali ; Sohail, Muhammad Khalid ; Ilahi, Manzoor ; Mufti, Muhammad Rafiq ; Faisal, Muhammad Imran</creatorcontrib><description>As an emerging and promising approach, crowdsourcing-based software development has become popular in many domains due to the participation of talented pool of developers in the contests, and to promote the ability of requesters (or customers) to choose the ‘wining’ solution with respect to their desired quality levels. However, due to lack of a central mechanism for team formation, continuity in the developer’s work on consecutive tasks and risk of noise in submissions of a contest, there is a gap between the requesters of a domain and their quality concerns related to the adaptation of a crowdsourcing-based software development platform. In order to address concerns and aid requesters, we describe three measures; Quality of Registrant Developers (QRD), Quality of Contest (QC) and Quality of Support (QS) to compute and predict the quality of a crowdsourcing-based platform through historical information on its completed tasks. We evaluate the capacity of the QRD, QC and QS as assessors to predict the quality. Subsequently, we implement a crawler to mine the information of completed development tasks from the TopCoder platform to inspect the proposed measures. The promising results of our QRD, QC, and QS measures suggest to use the proposed measures to the requesters and researchers of other domains such as pharmaceutical research and development, in order to investigate and predict the quality of crowdsourcing-based software development platforms.</description><identifier>ISSN: 1381-298X</identifier><identifier>EISSN: 1572-9346</identifier><identifier>DOI: 10.1007/s10588-018-9269-5</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Artificial Intelligence ; Assessors ; Business and Management ; Crowdsourcing ; Customers ; Management ; Methodology of the Social Sciences ; Noise ; Operations Research/Decision Theory ; Organization theory ; Platforms ; Quality ; Quality control ; R&D ; Research & development ; S.i. : Cmkbo ; Sociology ; Software ; Software development ; Teams</subject><ispartof>Computational and mathematical organization theory, 2019-06, Vol.25 (2), p.122-131</ispartof><rights>Springer Science+Business Media, LLC, part of Springer Nature 2018</rights><rights>Computational and Mathematical Organization Theory is a copyright of Springer, (2018). All Rights Reserved.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c348t-2814c5ec563c353ed4eec82886a49e15a630fefb82f575410e1d6ac742c024413</citedby><cites>FETCH-LOGICAL-c348t-2814c5ec563c353ed4eec82886a49e15a630fefb82f575410e1d6ac742c024413</cites><orcidid>0000-0003-2846-5347</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s10588-018-9269-5$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s10588-018-9269-5$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Habib, Asad</creatorcontrib><creatorcontrib>Hussain, Shahid</creatorcontrib><creatorcontrib>Khan, Arif Ali</creatorcontrib><creatorcontrib>Sohail, Muhammad Khalid</creatorcontrib><creatorcontrib>Ilahi, Manzoor</creatorcontrib><creatorcontrib>Mufti, Muhammad Rafiq</creatorcontrib><creatorcontrib>Faisal, Muhammad Imran</creatorcontrib><title>Knowledge based quality analysis of crowdsourced software development platforms</title><title>Computational and mathematical organization theory</title><addtitle>Comput Math Organ Theory</addtitle><description>As an emerging and promising approach, crowdsourcing-based software development has become popular in many domains due to the participation of talented pool of developers in the contests, and to promote the ability of requesters (or customers) to choose the ‘wining’ solution with respect to their desired quality levels. However, due to lack of a central mechanism for team formation, continuity in the developer’s work on consecutive tasks and risk of noise in submissions of a contest, there is a gap between the requesters of a domain and their quality concerns related to the adaptation of a crowdsourcing-based software development platform. In order to address concerns and aid requesters, we describe three measures; Quality of Registrant Developers (QRD), Quality of Contest (QC) and Quality of Support (QS) to compute and predict the quality of a crowdsourcing-based platform through historical information on its completed tasks. We evaluate the capacity of the QRD, QC and QS as assessors to predict the quality. Subsequently, we implement a crawler to mine the information of completed development tasks from the TopCoder platform to inspect the proposed measures. The promising results of our QRD, QC, and QS measures suggest to use the proposed measures to the requesters and researchers of other domains such as pharmaceutical research and development, in order to investigate and predict the quality of crowdsourcing-based software development platforms.</description><subject>Artificial Intelligence</subject><subject>Assessors</subject><subject>Business and Management</subject><subject>Crowdsourcing</subject><subject>Customers</subject><subject>Management</subject><subject>Methodology of the Social Sciences</subject><subject>Noise</subject><subject>Operations Research/Decision Theory</subject><subject>Organization theory</subject><subject>Platforms</subject><subject>Quality</subject><subject>Quality control</subject><subject>R&D</subject><subject>Research & development</subject><subject>S.i. : Cmkbo</subject><subject>Sociology</subject><subject>Software</subject><subject>Software development</subject><subject>Teams</subject><issn>1381-298X</issn><issn>1572-9346</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNp1kE1LAzEQhoMoWKs_wFvAczSfu8lRil9Y6EXBW0izk9Ky3WyTraX_3pQVPHmaOTzvy8yD0C2j94zS-iEzqrQmlGlieGWIOkMTpmpOjJDVedmFZoQb_XWJrnLeUEpNLegELd67eGihWQFeugwN3u1dux6O2HWuPeZ1xjFgn-KhyXGffAFyDMPBJcANfEMb-y10A-5bN4SYtvkaXQTXZrj5nVP0-fz0MXsl88XL2-xxTryQeiBcM-kVeFUJL5SARgJ4zbWunDTAlKsEDRCWmgdVK8kosKZyvpbcUy4lE1N0N_b2Ke72kAe7KfeVm7PllNfGaFpXhWIjVT7IOUGwfVpvXTpaRu3Jmx292eLNnrxZVTJ8zOTCditIf83_h34A2GVxPA</recordid><startdate>20190601</startdate><enddate>20190601</enddate><creator>Habib, Asad</creator><creator>Hussain, Shahid</creator><creator>Khan, Arif Ali</creator><creator>Sohail, Muhammad Khalid</creator><creator>Ilahi, Manzoor</creator><creator>Mufti, Muhammad Rafiq</creator><creator>Faisal, Muhammad Imran</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7TA</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>88I</scope><scope>8AL</scope><scope>8AO</scope><scope>8BJ</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FQK</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JBE</scope><scope>JG9</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L6V</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2P</scope><scope>M7S</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PTHSS</scope><scope>PYYUZ</scope><scope>Q9U</scope><orcidid>https://orcid.org/0000-0003-2846-5347</orcidid></search><sort><creationdate>20190601</creationdate><title>Knowledge based quality analysis of crowdsourced software development platforms</title><author>Habib, Asad ; Hussain, Shahid ; Khan, Arif Ali ; Sohail, Muhammad Khalid ; Ilahi, Manzoor ; Mufti, Muhammad Rafiq ; Faisal, Muhammad Imran</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c348t-2814c5ec563c353ed4eec82886a49e15a630fefb82f575410e1d6ac742c024413</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Artificial Intelligence</topic><topic>Assessors</topic><topic>Business and Management</topic><topic>Crowdsourcing</topic><topic>Customers</topic><topic>Management</topic><topic>Methodology of the Social Sciences</topic><topic>Noise</topic><topic>Operations Research/Decision Theory</topic><topic>Organization theory</topic><topic>Platforms</topic><topic>Quality</topic><topic>Quality control</topic><topic>R&D</topic><topic>Research & development</topic><topic>S.i. : Cmkbo</topic><topic>Sociology</topic><topic>Software</topic><topic>Software development</topic><topic>Teams</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Habib, Asad</creatorcontrib><creatorcontrib>Hussain, Shahid</creatorcontrib><creatorcontrib>Khan, Arif Ali</creatorcontrib><creatorcontrib>Sohail, Muhammad Khalid</creatorcontrib><creatorcontrib>Ilahi, Manzoor</creatorcontrib><creatorcontrib>Mufti, Muhammad Rafiq</creatorcontrib><creatorcontrib>Faisal, Muhammad Imran</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>Materials Business File</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Science Database (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>International Bibliography of the Social Sciences (IBSS)</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>International Bibliography of the Social Sciences</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>International Bibliography of the Social Sciences</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>ProQuest Engineering Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Science Database</collection><collection>Engineering Database</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>Engineering Collection</collection><collection>ABI/INFORM Collection China</collection><collection>ProQuest Central Basic</collection><jtitle>Computational and mathematical organization theory</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Habib, Asad</au><au>Hussain, Shahid</au><au>Khan, Arif Ali</au><au>Sohail, Muhammad Khalid</au><au>Ilahi, Manzoor</au><au>Mufti, Muhammad Rafiq</au><au>Faisal, Muhammad Imran</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Knowledge based quality analysis of crowdsourced software development platforms</atitle><jtitle>Computational and mathematical organization theory</jtitle><stitle>Comput Math Organ Theory</stitle><date>2019-06-01</date><risdate>2019</risdate><volume>25</volume><issue>2</issue><spage>122</spage><epage>131</epage><pages>122-131</pages><issn>1381-298X</issn><eissn>1572-9346</eissn><abstract>As an emerging and promising approach, crowdsourcing-based software development has become popular in many domains due to the participation of talented pool of developers in the contests, and to promote the ability of requesters (or customers) to choose the ‘wining’ solution with respect to their desired quality levels. However, due to lack of a central mechanism for team formation, continuity in the developer’s work on consecutive tasks and risk of noise in submissions of a contest, there is a gap between the requesters of a domain and their quality concerns related to the adaptation of a crowdsourcing-based software development platform. In order to address concerns and aid requesters, we describe three measures; Quality of Registrant Developers (QRD), Quality of Contest (QC) and Quality of Support (QS) to compute and predict the quality of a crowdsourcing-based platform through historical information on its completed tasks. We evaluate the capacity of the QRD, QC and QS as assessors to predict the quality. Subsequently, we implement a crawler to mine the information of completed development tasks from the TopCoder platform to inspect the proposed measures. The promising results of our QRD, QC, and QS measures suggest to use the proposed measures to the requesters and researchers of other domains such as pharmaceutical research and development, in order to investigate and predict the quality of crowdsourcing-based software development platforms.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s10588-018-9269-5</doi><tpages>10</tpages><orcidid>https://orcid.org/0000-0003-2846-5347</orcidid></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1381-298X |
| ispartof | Computational and mathematical organization theory, 2019-06, Vol.25 (2), p.122-131 |
| issn | 1381-298X 1572-9346 |
| language | eng |
| recordid | cdi_proquest_journals_2027998076 |
| source | SpringerLink Journals - AutoHoldings |
| subjects | Artificial Intelligence Assessors Business and Management Crowdsourcing Customers Management Methodology of the Social Sciences Noise Operations Research/Decision Theory Organization theory Platforms Quality Quality control R&D Research & development S.i. : Cmkbo Sociology Software Software development Teams |
| title | Knowledge based quality analysis of crowdsourced software development platforms |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T22%3A50%3A15IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Knowledge%20based%20quality%20analysis%20of%20crowdsourced%20software%20development%20platforms&rft.jtitle=Computational%20and%20mathematical%20organization%20theory&rft.au=Habib,%20Asad&rft.date=2019-06-01&rft.volume=25&rft.issue=2&rft.spage=122&rft.epage=131&rft.pages=122-131&rft.issn=1381-298X&rft.eissn=1572-9346&rft_id=info:doi/10.1007/s10588-018-9269-5&rft_dat=%3Cproquest_cross%3E2027998076%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2027998076&rft_id=info:pmid/&rfr_iscdi=true |