RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods
Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fi...
Gespeichert in:
| Veröffentlicht in: | IEEE transactions on multimedia 2018-01, Vol.20 (1), p.119-127 |
|---|---|
| Hauptverfasser: | , , , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext bestellen |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | 127 |
|---|---|
| container_issue | 1 |
| container_start_page | 119 |
| container_title | IEEE transactions on multimedia |
| container_volume | 20 |
| creator | Ioannakis, George Koutsoudis, Anestis Pratikakis, Ioannis Chamzas, Christodoulos |
| description | Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fine-tuning in order to achieve a robust operation for a given set of requirements specification. In this work, we present RETRIEVAL, a Web-based integrated information retrieval performance evaluation platform. It offers a number of metrics that are popular within the scientific community, so as to compose an efficient framework for implementing performance evaluation. We discuss the functionality of RETRIEVAL by citing important aspects such as the data input approaches, the user-level performance metrics parameterization, the evaluation scenarios, the interactive plots, and the performance reports repository that offers both archiving and download functionalities. |
| doi_str_mv | 10.1109/TMM.2017.2716193 |
| format | Article |
| fullrecord | <record><control><sourceid>crossref_RIE</sourceid><recordid>TN_cdi_ieee_primary_7949020</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>7949020</ieee_id><sourcerecordid>10_1109_TMM_2017_2716193</sourcerecordid><originalsourceid>FETCH-LOGICAL-c310t-14f9ddfc2468633d2c4e9e53c538824012d1510eb4668e20fba34f254b0f28f33</originalsourceid><addsrcrecordid>eNo9kEtLxEAQhAdRcF29C17mDyR2zyPJHJcluoENqyF6DXn0YCSbyCQK_nuzDzx101XVBR9j9wg-IpjHPE19ARj6IsQAjbxgCzQKPYAwvJx3LcAzAuGa3YzjJwAqDeGCvWZxniXx-2rrrXq-67u2J_5Czg5uX_Y18fin7L7LqR16ng9Dx2eBJ_1RPh4zmlxLs4mnNH0MzXjLrmzZjXR3nkv29hTn64233T0n67mnlgiTh8qaprG1UEEUSNmIWpEhLWsto0goQNGgRqBKBUFEAmxVSmWFVhVYEVkplwxOf2s3jKMjW3y5dl-63wKhOCApZiTFAUlxRjJHHk6Rloj-7aFRBgTIP5v7XA4</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods</title><source>IEEE Electronic Library (IEL)</source><creator>Ioannakis, George ; Koutsoudis, Anestis ; Pratikakis, Ioannis ; Chamzas, Christodoulos</creator><creatorcontrib>Ioannakis, George ; Koutsoudis, Anestis ; Pratikakis, Ioannis ; Chamzas, Christodoulos</creatorcontrib><description>Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fine-tuning in order to achieve a robust operation for a given set of requirements specification. In this work, we present RETRIEVAL, a Web-based integrated information retrieval performance evaluation platform. It offers a number of metrics that are popular within the scientific community, so as to compose an efficient framework for implementing performance evaluation. We discuss the functionality of RETRIEVAL by citing important aspects such as the data input approaches, the user-level performance metrics parameterization, the evaluation scenarios, the interactive plots, and the performance reports repository that offers both archiving and download functionalities.</description><identifier>ISSN: 1520-9210</identifier><identifier>EISSN: 1941-0077</identifier><identifier>DOI: 10.1109/TMM.2017.2716193</identifier><identifier>CODEN: ITMUF8</identifier><language>eng</language><publisher>IEEE</publisher><subject>Benchmark testing ; Evaluation ; Indexes ; information ; Information retrieval ; metrics ; Multimedia communication ; Performance evaluation ; retrieval ; Web</subject><ispartof>IEEE transactions on multimedia, 2018-01, Vol.20 (1), p.119-127</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c310t-14f9ddfc2468633d2c4e9e53c538824012d1510eb4668e20fba34f254b0f28f33</citedby><cites>FETCH-LOGICAL-c310t-14f9ddfc2468633d2c4e9e53c538824012d1510eb4668e20fba34f254b0f28f33</cites><orcidid>0000-0001-9862-7335</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/7949020$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,780,784,796,27924,27925,54758</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/7949020$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Ioannakis, George</creatorcontrib><creatorcontrib>Koutsoudis, Anestis</creatorcontrib><creatorcontrib>Pratikakis, Ioannis</creatorcontrib><creatorcontrib>Chamzas, Christodoulos</creatorcontrib><title>RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods</title><title>IEEE transactions on multimedia</title><addtitle>TMM</addtitle><description>Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fine-tuning in order to achieve a robust operation for a given set of requirements specification. In this work, we present RETRIEVAL, a Web-based integrated information retrieval performance evaluation platform. It offers a number of metrics that are popular within the scientific community, so as to compose an efficient framework for implementing performance evaluation. We discuss the functionality of RETRIEVAL by citing important aspects such as the data input approaches, the user-level performance metrics parameterization, the evaluation scenarios, the interactive plots, and the performance reports repository that offers both archiving and download functionalities.</description><subject>Benchmark testing</subject><subject>Evaluation</subject><subject>Indexes</subject><subject>information</subject><subject>Information retrieval</subject><subject>metrics</subject><subject>Multimedia communication</subject><subject>Performance evaluation</subject><subject>retrieval</subject><subject>Web</subject><issn>1520-9210</issn><issn>1941-0077</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2018</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kEtLxEAQhAdRcF29C17mDyR2zyPJHJcluoENqyF6DXn0YCSbyCQK_nuzDzx101XVBR9j9wg-IpjHPE19ARj6IsQAjbxgCzQKPYAwvJx3LcAzAuGa3YzjJwAqDeGCvWZxniXx-2rrrXq-67u2J_5Czg5uX_Y18fin7L7LqR16ng9Dx2eBJ_1RPh4zmlxLs4mnNH0MzXjLrmzZjXR3nkv29hTn64233T0n67mnlgiTh8qaprG1UEEUSNmIWpEhLWsto0goQNGgRqBKBUFEAmxVSmWFVhVYEVkplwxOf2s3jKMjW3y5dl-63wKhOCApZiTFAUlxRjJHHk6Rloj-7aFRBgTIP5v7XA4</recordid><startdate>201801</startdate><enddate>201801</enddate><creator>Ioannakis, George</creator><creator>Koutsoudis, Anestis</creator><creator>Pratikakis, Ioannis</creator><creator>Chamzas, Christodoulos</creator><general>IEEE</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0001-9862-7335</orcidid></search><sort><creationdate>201801</creationdate><title>RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods</title><author>Ioannakis, George ; Koutsoudis, Anestis ; Pratikakis, Ioannis ; Chamzas, Christodoulos</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c310t-14f9ddfc2468633d2c4e9e53c538824012d1510eb4668e20fba34f254b0f28f33</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2018</creationdate><topic>Benchmark testing</topic><topic>Evaluation</topic><topic>Indexes</topic><topic>information</topic><topic>Information retrieval</topic><topic>metrics</topic><topic>Multimedia communication</topic><topic>Performance evaluation</topic><topic>retrieval</topic><topic>Web</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Ioannakis, George</creatorcontrib><creatorcontrib>Koutsoudis, Anestis</creatorcontrib><creatorcontrib>Pratikakis, Ioannis</creatorcontrib><creatorcontrib>Chamzas, Christodoulos</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><jtitle>IEEE transactions on multimedia</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Ioannakis, George</au><au>Koutsoudis, Anestis</au><au>Pratikakis, Ioannis</au><au>Chamzas, Christodoulos</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods</atitle><jtitle>IEEE transactions on multimedia</jtitle><stitle>TMM</stitle><date>2018-01</date><risdate>2018</risdate><volume>20</volume><issue>1</issue><spage>119</spage><epage>127</epage><pages>119-127</pages><issn>1520-9210</issn><eissn>1941-0077</eissn><coden>ITMUF8</coden><abstract>Performance evaluation is one of the main research topics in information retrieval. Evaluation metrics are used to quantify various performance aspects of a retrieval method. These metrics assist in identifying the optimum method for a specific retrieval challenge but also to allow its parameters fine-tuning in order to achieve a robust operation for a given set of requirements specification. In this work, we present RETRIEVAL, a Web-based integrated information retrieval performance evaluation platform. It offers a number of metrics that are popular within the scientific community, so as to compose an efficient framework for implementing performance evaluation. We discuss the functionality of RETRIEVAL by citing important aspects such as the data input approaches, the user-level performance metrics parameterization, the evaluation scenarios, the interactive plots, and the performance reports repository that offers both archiving and download functionalities.</abstract><pub>IEEE</pub><doi>10.1109/TMM.2017.2716193</doi><tpages>9</tpages><orcidid>https://orcid.org/0000-0001-9862-7335</orcidid></addata></record> |
| fulltext | fulltext_linktorsrc |
| identifier | ISSN: 1520-9210 |
| ispartof | IEEE transactions on multimedia, 2018-01, Vol.20 (1), p.119-127 |
| issn | 1520-9210 1941-0077 |
| language | eng |
| recordid | cdi_ieee_primary_7949020 |
| source | IEEE Electronic Library (IEL) |
| subjects | Benchmark testing Evaluation Indexes information Information retrieval metrics Multimedia communication Performance evaluation retrieval Web |
| title | RETRIEVAL-An Online Performance Evaluation Tool for Information Retrieval Methods |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-29T09%3A51%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=RETRIEVAL-An%20Online%20Performance%20Evaluation%20Tool%20for%20Information%20Retrieval%20Methods&rft.jtitle=IEEE%20transactions%20on%20multimedia&rft.au=Ioannakis,%20George&rft.date=2018-01&rft.volume=20&rft.issue=1&rft.spage=119&rft.epage=127&rft.pages=119-127&rft.issn=1520-9210&rft.eissn=1941-0077&rft.coden=ITMUF8&rft_id=info:doi/10.1109/TMM.2017.2716193&rft_dat=%3Ccrossref_RIE%3E10_1109_TMM_2017_2716193%3C/crossref_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_ieee_id=7949020&rfr_iscdi=true |