Re-examination of interestingness measures in pattern mining: a unified framework
Numerous interestingness measures have been proposed in statistics and data mining to assess object relationships. This is especially important in recent studies of association or correlation pattern mining. However, it is still not clear whether there is any intrinsic relationship among many propos...
Gespeichert in:
Veröffentlicht in: | Data mining and knowledge discovery 2010-11, Vol.21 (3), p.371-397 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 397 |
---|---|
container_issue | 3 |
container_start_page | 371 |
container_title | Data mining and knowledge discovery |
container_volume | 21 |
creator | Wu, Tianyi Chen, Yuguo Han, Jiawei |
description | Numerous interestingness measures have been proposed in statistics and data mining to assess object relationships. This is especially important in recent studies of association or correlation pattern mining. However, it is still not clear whether there is any intrinsic relationship among many proposed measures, and which one is truly effective at gauging object relationships in
large data sets
. Recent studies have identified a critical property,
null-(transaction) invariance
, for measuring associations among events in large data sets, but many measures do not have this property. In this study, we re-examine a set of null-invariant interestingness measures and find that they can be expressed as the generalized mathematical mean, leading to a total ordering of them. Such a unified framework provides insights into the underlying philosophy of the measures and helps us understand and select the proper measure for different applications. Moreover, we propose a new measure called
Imbalance Ratio
to gauge the degree of skewness of a data set. We also discuss the efficient computation of interesting patterns of different null-invariant interestingness measures by proposing an algorithm, GAMiner, which complements previous studies. Experimental evaluation verifies the effectiveness of the unified framework and shows that GAMiner speeds up the state-of-the-art algorithm by an order of magnitude. |
doi_str_mv | 10.1007/s10618-009-0161-2 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_787295778</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2123371611</sourcerecordid><originalsourceid>FETCH-LOGICAL-c413t-ee6b5bd3a1d96790031525a7a839e8be58c2cc4004f66fb211a82b8bae7901ed3</originalsourceid><addsrcrecordid>eNp1kE9LxDAQxYsouK5-AG_Fi6foTNo0iTcR_8GCKAreQtpOl67bdE1a1G9vlgqC4GmGeb83PF6SHCOcIYA8DwgFKgagGWCBjO8kMxQyY1IUr7txz1TOhELYTw5CWAGA4BnMkscnYvRpu9bZoe1d2jdp6wbyFIbWLR2FkHZkwxgPUUg3doiiSyMf5YvUpqNrm5bqtPG2o4_evx0me41dBzr6mfPk5eb6-eqOLR5u768uF6zKMRsYUVGKss4s1rqQGiBDwYWVVmWaVElCVbyqcoC8KYqm5IhW8VKVliKMVGfz5HT6u_H9-xjzmq4NFa3X1lE_BiOV5FpIqSJ58odc9aN3MZyRudRCaY0RwgmqfB-Cp8ZsfNtZ_2UQzLZiM1VsYsVmW7Hh0cMnT4isW5L_ffy_6Rsv437h</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>747958991</pqid></control><display><type>article</type><title>Re-examination of interestingness measures in pattern mining: a unified framework</title><source>SpringerLink Journals - AutoHoldings</source><creator>Wu, Tianyi ; Chen, Yuguo ; Han, Jiawei</creator><creatorcontrib>Wu, Tianyi ; Chen, Yuguo ; Han, Jiawei</creatorcontrib><description>Numerous interestingness measures have been proposed in statistics and data mining to assess object relationships. This is especially important in recent studies of association or correlation pattern mining. However, it is still not clear whether there is any intrinsic relationship among many proposed measures, and which one is truly effective at gauging object relationships in
large data sets
. Recent studies have identified a critical property,
null-(transaction) invariance
, for measuring associations among events in large data sets, but many measures do not have this property. In this study, we re-examine a set of null-invariant interestingness measures and find that they can be expressed as the generalized mathematical mean, leading to a total ordering of them. Such a unified framework provides insights into the underlying philosophy of the measures and helps us understand and select the proper measure for different applications. Moreover, we propose a new measure called
Imbalance Ratio
to gauge the degree of skewness of a data set. We also discuss the efficient computation of interesting patterns of different null-invariant interestingness measures by proposing an algorithm, GAMiner, which complements previous studies. Experimental evaluation verifies the effectiveness of the unified framework and shows that GAMiner speeds up the state-of-the-art algorithm by an order of magnitude.</description><identifier>ISSN: 1384-5810</identifier><identifier>EISSN: 1573-756X</identifier><identifier>DOI: 10.1007/s10618-009-0161-2</identifier><language>eng</language><publisher>Boston: Springer US</publisher><subject>Algorithms ; Artificial Intelligence ; Associations ; Chemistry and Earth Sciences ; Coffee ; Complement ; Computational efficiency ; Computer Science ; Contingency tables ; Data mining ; Data Mining and Knowledge Discovery ; Datasets ; Information Storage and Retrieval ; Mathematical models ; Mining ; Order disorder ; Philosophy ; Physics ; Statistics for Engineering</subject><ispartof>Data mining and knowledge discovery, 2010-11, Vol.21 (3), p.371-397</ispartof><rights>The Author(s) 2009</rights><rights>The Author(s) 2010</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c413t-ee6b5bd3a1d96790031525a7a839e8be58c2cc4004f66fb211a82b8bae7901ed3</citedby><cites>FETCH-LOGICAL-c413t-ee6b5bd3a1d96790031525a7a839e8be58c2cc4004f66fb211a82b8bae7901ed3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s10618-009-0161-2$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s10618-009-0161-2$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Wu, Tianyi</creatorcontrib><creatorcontrib>Chen, Yuguo</creatorcontrib><creatorcontrib>Han, Jiawei</creatorcontrib><title>Re-examination of interestingness measures in pattern mining: a unified framework</title><title>Data mining and knowledge discovery</title><addtitle>Data Min Knowl Disc</addtitle><description>Numerous interestingness measures have been proposed in statistics and data mining to assess object relationships. This is especially important in recent studies of association or correlation pattern mining. However, it is still not clear whether there is any intrinsic relationship among many proposed measures, and which one is truly effective at gauging object relationships in
large data sets
. Recent studies have identified a critical property,
null-(transaction) invariance
, for measuring associations among events in large data sets, but many measures do not have this property. In this study, we re-examine a set of null-invariant interestingness measures and find that they can be expressed as the generalized mathematical mean, leading to a total ordering of them. Such a unified framework provides insights into the underlying philosophy of the measures and helps us understand and select the proper measure for different applications. Moreover, we propose a new measure called
Imbalance Ratio
to gauge the degree of skewness of a data set. We also discuss the efficient computation of interesting patterns of different null-invariant interestingness measures by proposing an algorithm, GAMiner, which complements previous studies. Experimental evaluation verifies the effectiveness of the unified framework and shows that GAMiner speeds up the state-of-the-art algorithm by an order of magnitude.</description><subject>Algorithms</subject><subject>Artificial Intelligence</subject><subject>Associations</subject><subject>Chemistry and Earth Sciences</subject><subject>Coffee</subject><subject>Complement</subject><subject>Computational efficiency</subject><subject>Computer Science</subject><subject>Contingency tables</subject><subject>Data mining</subject><subject>Data Mining and Knowledge Discovery</subject><subject>Datasets</subject><subject>Information Storage and Retrieval</subject><subject>Mathematical models</subject><subject>Mining</subject><subject>Order disorder</subject><subject>Philosophy</subject><subject>Physics</subject><subject>Statistics for Engineering</subject><issn>1384-5810</issn><issn>1573-756X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2010</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>BENPR</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp1kE9LxDAQxYsouK5-AG_Fi6foTNo0iTcR_8GCKAreQtpOl67bdE1a1G9vlgqC4GmGeb83PF6SHCOcIYA8DwgFKgagGWCBjO8kMxQyY1IUr7txz1TOhELYTw5CWAGA4BnMkscnYvRpu9bZoe1d2jdp6wbyFIbWLR2FkHZkwxgPUUg3doiiSyMf5YvUpqNrm5bqtPG2o4_evx0me41dBzr6mfPk5eb6-eqOLR5u768uF6zKMRsYUVGKss4s1rqQGiBDwYWVVmWaVElCVbyqcoC8KYqm5IhW8VKVliKMVGfz5HT6u_H9-xjzmq4NFa3X1lE_BiOV5FpIqSJ58odc9aN3MZyRudRCaY0RwgmqfB-Cp8ZsfNtZ_2UQzLZiM1VsYsVmW7Hh0cMnT4isW5L_ffy_6Rsv437h</recordid><startdate>20101101</startdate><enddate>20101101</enddate><creator>Wu, Tianyi</creator><creator>Chen, Yuguo</creator><creator>Han, Jiawei</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope></search><sort><creationdate>20101101</creationdate><title>Re-examination of interestingness measures in pattern mining: a unified framework</title><author>Wu, Tianyi ; Chen, Yuguo ; Han, Jiawei</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c413t-ee6b5bd3a1d96790031525a7a839e8be58c2cc4004f66fb211a82b8bae7901ed3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2010</creationdate><topic>Algorithms</topic><topic>Artificial Intelligence</topic><topic>Associations</topic><topic>Chemistry and Earth Sciences</topic><topic>Coffee</topic><topic>Complement</topic><topic>Computational efficiency</topic><topic>Computer Science</topic><topic>Contingency tables</topic><topic>Data mining</topic><topic>Data Mining and Knowledge Discovery</topic><topic>Datasets</topic><topic>Information Storage and Retrieval</topic><topic>Mathematical models</topic><topic>Mining</topic><topic>Order disorder</topic><topic>Philosophy</topic><topic>Physics</topic><topic>Statistics for Engineering</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Wu, Tianyi</creatorcontrib><creatorcontrib>Chen, Yuguo</creatorcontrib><creatorcontrib>Han, Jiawei</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Data mining and knowledge discovery</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Wu, Tianyi</au><au>Chen, Yuguo</au><au>Han, Jiawei</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Re-examination of interestingness measures in pattern mining: a unified framework</atitle><jtitle>Data mining and knowledge discovery</jtitle><stitle>Data Min Knowl Disc</stitle><date>2010-11-01</date><risdate>2010</risdate><volume>21</volume><issue>3</issue><spage>371</spage><epage>397</epage><pages>371-397</pages><issn>1384-5810</issn><eissn>1573-756X</eissn><abstract>Numerous interestingness measures have been proposed in statistics and data mining to assess object relationships. This is especially important in recent studies of association or correlation pattern mining. However, it is still not clear whether there is any intrinsic relationship among many proposed measures, and which one is truly effective at gauging object relationships in
large data sets
. Recent studies have identified a critical property,
null-(transaction) invariance
, for measuring associations among events in large data sets, but many measures do not have this property. In this study, we re-examine a set of null-invariant interestingness measures and find that they can be expressed as the generalized mathematical mean, leading to a total ordering of them. Such a unified framework provides insights into the underlying philosophy of the measures and helps us understand and select the proper measure for different applications. Moreover, we propose a new measure called
Imbalance Ratio
to gauge the degree of skewness of a data set. We also discuss the efficient computation of interesting patterns of different null-invariant interestingness measures by proposing an algorithm, GAMiner, which complements previous studies. Experimental evaluation verifies the effectiveness of the unified framework and shows that GAMiner speeds up the state-of-the-art algorithm by an order of magnitude.</abstract><cop>Boston</cop><pub>Springer US</pub><doi>10.1007/s10618-009-0161-2</doi><tpages>27</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1384-5810 |
ispartof | Data mining and knowledge discovery, 2010-11, Vol.21 (3), p.371-397 |
issn | 1384-5810 1573-756X |
language | eng |
recordid | cdi_proquest_miscellaneous_787295778 |
source | SpringerLink Journals - AutoHoldings |
subjects | Algorithms Artificial Intelligence Associations Chemistry and Earth Sciences Coffee Complement Computational efficiency Computer Science Contingency tables Data mining Data Mining and Knowledge Discovery Datasets Information Storage and Retrieval Mathematical models Mining Order disorder Philosophy Physics Statistics for Engineering |
title | Re-examination of interestingness measures in pattern mining: a unified framework |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T17%3A31%3A34IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Re-examination%20of%20interestingness%20measures%20in%20pattern%20mining:%20a%20unified%20framework&rft.jtitle=Data%20mining%20and%20knowledge%20discovery&rft.au=Wu,%20Tianyi&rft.date=2010-11-01&rft.volume=21&rft.issue=3&rft.spage=371&rft.epage=397&rft.pages=371-397&rft.issn=1384-5810&rft.eissn=1573-756X&rft_id=info:doi/10.1007/s10618-009-0161-2&rft_dat=%3Cproquest_cross%3E2123371611%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=747958991&rft_id=info:pmid/&rfr_iscdi=true |