A general framework for predictive tensor modeling with domain knowledge
In many real applications such as virtual metrology in semiconductor manufacturing, face recognition, and gait recognition in computer vision, the input data is naturally expressed as tensors or multi-dimensional arrays. Furthermore, in addition to the known label information, domain knowledge can o...
Gespeichert in:
Veröffentlicht in: | Data mining and knowledge discovery 2015-11, Vol.29 (6), p.1709-1732 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 1732 |
---|---|
container_issue | 6 |
container_start_page | 1709 |
container_title | Data mining and knowledge discovery |
container_volume | 29 |
creator | Zhu, Yada He, Jingrui Lawrence, Richard D. |
description | In many real applications such as virtual metrology in semiconductor manufacturing, face recognition, and gait recognition in computer vision, the input data is naturally expressed as tensors or multi-dimensional arrays. Furthermore, in addition to the known label information, domain knowledge can often be obtained from various sources, e.g., multiple domain experts. To address such problems, in this paper, we propose a general optimization framework for dealing with tensor inputs while taking into consideration domain knowledge. To be specific, our framework is based on a linear model, and we obtain the weight tensor in a hierarchical way—first approximate it by a low-rank tensor, and then estimate the low-rank approximation using the domain knowledge from various sources. This is motivated by wafer quality prediction in semiconductor manufacturing. We also propose an effective algorithm named
H-MOTE
for solving this framework, which is guaranteed to converge. For each iteration, the time complexity of
H-MOTE
is linear with respect to the number of examples as well as the size of the weight tensor. Therefore,
H-MOTE
is scalable to large-scale problems. Experimental results show that
H-MOTE
outperforms state-of-the-art techniques on both synthetic and real data sets. |
doi_str_mv | 10.1007/s10618-014-0392-8 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1753543259</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3817419771</sourcerecordid><originalsourceid>FETCH-LOGICAL-c419t-8c6bf1ef6d69cd8c36b6d5dde06bd5c40d6cf89bfbc1d73832d8702c566e7dbc3</originalsourceid><addsrcrecordid>eNp1kE1LxDAQhosouK7-AG8BL16q-WjS9Lgs6gqCFwVvoU0mtbttsiZdF_-9WepBBE8zDM_7MjxZdknwDcG4vI0ECyJzTIocs4rm8iibEV6yvOTi7TjtTBY5lwSfZmcxrjHGnDI8y1YL1IKDUPfIhnqAvQ8bZH1A2wCm02P3CWgEF9Nl8Ab6zrVo343vyPih7hzaOL_vwbRwnp3Yuo9w8TPn2ev93ctylT89PzwuF0-5Lkg15lKLxhKwwohKG6mZaIThxgAWjeG6wEZoK6vGNpqYkklGjSwx1VwIKE2j2Ty7nnq3wX_sII5q6KKGvq8d-F1UpOSMF4zyKqFXf9C13wWXvksUERQzWtFEkYnSwccYwKpt6IY6fCmC1cGtmtyq5FYd3CqZMnTKxMS6FsKv5n9D36LTfOo</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1716203292</pqid></control><display><type>article</type><title>A general framework for predictive tensor modeling with domain knowledge</title><source>SpringerLink Journals - AutoHoldings</source><creator>Zhu, Yada ; He, Jingrui ; Lawrence, Richard D.</creator><creatorcontrib>Zhu, Yada ; He, Jingrui ; Lawrence, Richard D.</creatorcontrib><description>In many real applications such as virtual metrology in semiconductor manufacturing, face recognition, and gait recognition in computer vision, the input data is naturally expressed as tensors or multi-dimensional arrays. Furthermore, in addition to the known label information, domain knowledge can often be obtained from various sources, e.g., multiple domain experts. To address such problems, in this paper, we propose a general optimization framework for dealing with tensor inputs while taking into consideration domain knowledge. To be specific, our framework is based on a linear model, and we obtain the weight tensor in a hierarchical way—first approximate it by a low-rank tensor, and then estimate the low-rank approximation using the domain knowledge from various sources. This is motivated by wafer quality prediction in semiconductor manufacturing. We also propose an effective algorithm named
H-MOTE
for solving this framework, which is guaranteed to converge. For each iteration, the time complexity of
H-MOTE
is linear with respect to the number of examples as well as the size of the weight tensor. Therefore,
H-MOTE
is scalable to large-scale problems. Experimental results show that
H-MOTE
outperforms state-of-the-art techniques on both synthetic and real data sets.</description><identifier>ISSN: 1384-5810</identifier><identifier>EISSN: 1573-756X</identifier><identifier>DOI: 10.1007/s10618-014-0392-8</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Algorithms ; Approximation ; Arrays ; Art techniques ; Artificial Intelligence ; Chemistry and Earth Sciences ; Computer Science ; Computer vision ; Data mining ; Data Mining and Knowledge Discovery ; Data processing ; Datasets ; Fault diagnosis ; Information Storage and Retrieval ; Knowledge ; Manufacturing ; Mathematical analysis ; Mathematical models ; Optimization ; Physics ; Process controls ; Semiconductors ; Statistics for Engineering ; Subject specialists ; Tensors ; Variables</subject><ispartof>Data mining and knowledge discovery, 2015-11, Vol.29 (6), p.1709-1732</ispartof><rights>The Author(s) 2014</rights><rights>The Author(s) 2015</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c419t-8c6bf1ef6d69cd8c36b6d5dde06bd5c40d6cf89bfbc1d73832d8702c566e7dbc3</citedby><cites>FETCH-LOGICAL-c419t-8c6bf1ef6d69cd8c36b6d5dde06bd5c40d6cf89bfbc1d73832d8702c566e7dbc3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s10618-014-0392-8$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s10618-014-0392-8$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27923,27924,41487,42556,51318</link.rule.ids></links><search><creatorcontrib>Zhu, Yada</creatorcontrib><creatorcontrib>He, Jingrui</creatorcontrib><creatorcontrib>Lawrence, Richard D.</creatorcontrib><title>A general framework for predictive tensor modeling with domain knowledge</title><title>Data mining and knowledge discovery</title><addtitle>Data Min Knowl Disc</addtitle><description>In many real applications such as virtual metrology in semiconductor manufacturing, face recognition, and gait recognition in computer vision, the input data is naturally expressed as tensors or multi-dimensional arrays. Furthermore, in addition to the known label information, domain knowledge can often be obtained from various sources, e.g., multiple domain experts. To address such problems, in this paper, we propose a general optimization framework for dealing with tensor inputs while taking into consideration domain knowledge. To be specific, our framework is based on a linear model, and we obtain the weight tensor in a hierarchical way—first approximate it by a low-rank tensor, and then estimate the low-rank approximation using the domain knowledge from various sources. This is motivated by wafer quality prediction in semiconductor manufacturing. We also propose an effective algorithm named
H-MOTE
for solving this framework, which is guaranteed to converge. For each iteration, the time complexity of
H-MOTE
is linear with respect to the number of examples as well as the size of the weight tensor. Therefore,
H-MOTE
is scalable to large-scale problems. Experimental results show that
H-MOTE
outperforms state-of-the-art techniques on both synthetic and real data sets.</description><subject>Algorithms</subject><subject>Approximation</subject><subject>Arrays</subject><subject>Art techniques</subject><subject>Artificial Intelligence</subject><subject>Chemistry and Earth Sciences</subject><subject>Computer Science</subject><subject>Computer vision</subject><subject>Data mining</subject><subject>Data Mining and Knowledge Discovery</subject><subject>Data processing</subject><subject>Datasets</subject><subject>Fault diagnosis</subject><subject>Information Storage and Retrieval</subject><subject>Knowledge</subject><subject>Manufacturing</subject><subject>Mathematical analysis</subject><subject>Mathematical models</subject><subject>Optimization</subject><subject>Physics</subject><subject>Process controls</subject><subject>Semiconductors</subject><subject>Statistics for Engineering</subject><subject>Subject specialists</subject><subject>Tensors</subject><subject>Variables</subject><issn>1384-5810</issn><issn>1573-756X</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2015</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp1kE1LxDAQhosouK7-AG8BL16q-WjS9Lgs6gqCFwVvoU0mtbttsiZdF_-9WepBBE8zDM_7MjxZdknwDcG4vI0ECyJzTIocs4rm8iibEV6yvOTi7TjtTBY5lwSfZmcxrjHGnDI8y1YL1IKDUPfIhnqAvQ8bZH1A2wCm02P3CWgEF9Nl8Ab6zrVo343vyPih7hzaOL_vwbRwnp3Yuo9w8TPn2ev93ctylT89PzwuF0-5Lkg15lKLxhKwwohKG6mZaIThxgAWjeG6wEZoK6vGNpqYkklGjSwx1VwIKE2j2Ty7nnq3wX_sII5q6KKGvq8d-F1UpOSMF4zyKqFXf9C13wWXvksUERQzWtFEkYnSwccYwKpt6IY6fCmC1cGtmtyq5FYd3CqZMnTKxMS6FsKv5n9D36LTfOo</recordid><startdate>20151101</startdate><enddate>20151101</enddate><creator>Zhu, Yada</creator><creator>He, Jingrui</creator><creator>Lawrence, Richard D.</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope></search><sort><creationdate>20151101</creationdate><title>A general framework for predictive tensor modeling with domain knowledge</title><author>Zhu, Yada ; He, Jingrui ; Lawrence, Richard D.</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c419t-8c6bf1ef6d69cd8c36b6d5dde06bd5c40d6cf89bfbc1d73832d8702c566e7dbc3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2015</creationdate><topic>Algorithms</topic><topic>Approximation</topic><topic>Arrays</topic><topic>Art techniques</topic><topic>Artificial Intelligence</topic><topic>Chemistry and Earth Sciences</topic><topic>Computer Science</topic><topic>Computer vision</topic><topic>Data mining</topic><topic>Data Mining and Knowledge Discovery</topic><topic>Data processing</topic><topic>Datasets</topic><topic>Fault diagnosis</topic><topic>Information Storage and Retrieval</topic><topic>Knowledge</topic><topic>Manufacturing</topic><topic>Mathematical analysis</topic><topic>Mathematical models</topic><topic>Optimization</topic><topic>Physics</topic><topic>Process controls</topic><topic>Semiconductors</topic><topic>Statistics for Engineering</topic><topic>Subject specialists</topic><topic>Tensors</topic><topic>Variables</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhu, Yada</creatorcontrib><creatorcontrib>He, Jingrui</creatorcontrib><creatorcontrib>Lawrence, Richard D.</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Data mining and knowledge discovery</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhu, Yada</au><au>He, Jingrui</au><au>Lawrence, Richard D.</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>A general framework for predictive tensor modeling with domain knowledge</atitle><jtitle>Data mining and knowledge discovery</jtitle><stitle>Data Min Knowl Disc</stitle><date>2015-11-01</date><risdate>2015</risdate><volume>29</volume><issue>6</issue><spage>1709</spage><epage>1732</epage><pages>1709-1732</pages><issn>1384-5810</issn><eissn>1573-756X</eissn><abstract>In many real applications such as virtual metrology in semiconductor manufacturing, face recognition, and gait recognition in computer vision, the input data is naturally expressed as tensors or multi-dimensional arrays. Furthermore, in addition to the known label information, domain knowledge can often be obtained from various sources, e.g., multiple domain experts. To address such problems, in this paper, we propose a general optimization framework for dealing with tensor inputs while taking into consideration domain knowledge. To be specific, our framework is based on a linear model, and we obtain the weight tensor in a hierarchical way—first approximate it by a low-rank tensor, and then estimate the low-rank approximation using the domain knowledge from various sources. This is motivated by wafer quality prediction in semiconductor manufacturing. We also propose an effective algorithm named
H-MOTE
for solving this framework, which is guaranteed to converge. For each iteration, the time complexity of
H-MOTE
is linear with respect to the number of examples as well as the size of the weight tensor. Therefore,
H-MOTE
is scalable to large-scale problems. Experimental results show that
H-MOTE
outperforms state-of-the-art techniques on both synthetic and real data sets.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s10618-014-0392-8</doi><tpages>24</tpages></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1384-5810 |
ispartof | Data mining and knowledge discovery, 2015-11, Vol.29 (6), p.1709-1732 |
issn | 1384-5810 1573-756X |
language | eng |
recordid | cdi_proquest_miscellaneous_1753543259 |
source | SpringerLink Journals - AutoHoldings |
subjects | Algorithms Approximation Arrays Art techniques Artificial Intelligence Chemistry and Earth Sciences Computer Science Computer vision Data mining Data Mining and Knowledge Discovery Data processing Datasets Fault diagnosis Information Storage and Retrieval Knowledge Manufacturing Mathematical analysis Mathematical models Optimization Physics Process controls Semiconductors Statistics for Engineering Subject specialists Tensors Variables |
title | A general framework for predictive tensor modeling with domain knowledge |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T08%3A45%3A51IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=A%20general%20framework%20for%20predictive%20tensor%20modeling%20with%20domain%20knowledge&rft.jtitle=Data%20mining%20and%20knowledge%20discovery&rft.au=Zhu,%20Yada&rft.date=2015-11-01&rft.volume=29&rft.issue=6&rft.spage=1709&rft.epage=1732&rft.pages=1709-1732&rft.issn=1384-5810&rft.eissn=1573-756X&rft_id=info:doi/10.1007/s10618-014-0392-8&rft_dat=%3Cproquest_cross%3E3817419771%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1716203292&rft_id=info:pmid/&rfr_iscdi=true |