Contextualized Machine Learning

We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applying deep learning to the meta-relationship between contextual information and context-specific parametric models. This is...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Lengerich, Benjamin, Ellington, Caleb N, Rubbi, Andrea, Kellis, Manolis, Xing, Eric P
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Lengerich, Benjamin
Ellington, Caleb N
Rubbi, Andrea
Kellis, Manolis
Xing, Eric P
description We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applying deep learning to the meta-relationship between contextual information and context-specific parametric models. This is a form of varying-coefficient modeling that unifies existing frameworks including cluster analysis and cohort modeling by introducing two reusable concepts: a context encoder which translates sample context into model parameters, and sample-specific model which operates on sample predictors. We review the process of developing contextualized models, nonparametric inference from contextualized models, and identifiability conditions of contextualized models. Finally, we present the open-source PyTorch package ContextualizedML.
doi_str_mv 10.48550/arxiv.2310.11340
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2310_11340</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2310_11340</sourcerecordid><originalsourceid>FETCH-LOGICAL-a1150-803401dabb8fc31659e26f27741e89eade5d734078867004c1293aa57c1947873</originalsourceid><addsrcrecordid>eNotjssOgjAQRbtxYdAPcCU_gHZoS8vSEF8Jxo2uyVgGbYJo8BH060V0dZOTm5PD2Aj4RBql-BTrxj0noWgBgJC8z8bJpbpTc39g6d6U-xu0J1eRnxLWlauOA9YrsLzR8L8e2y_mu2QVpNvlOpmlAQIoHhje2iDHw8EUVkCkYgqjItRaApmYMCeV6_aijYk059JCGAtEpS3EUhstPDb-ebvE7Fq7M9av7JuadaniA1mZNpY</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Contextualized Machine Learning</title><source>arXiv.org</source><creator>Lengerich, Benjamin ; Ellington, Caleb N ; Rubbi, Andrea ; Kellis, Manolis ; Xing, Eric P</creator><creatorcontrib>Lengerich, Benjamin ; Ellington, Caleb N ; Rubbi, Andrea ; Kellis, Manolis ; Xing, Eric P</creatorcontrib><description>We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applying deep learning to the meta-relationship between contextual information and context-specific parametric models. This is a form of varying-coefficient modeling that unifies existing frameworks including cluster analysis and cohort modeling by introducing two reusable concepts: a context encoder which translates sample context into model parameters, and sample-specific model which operates on sample predictors. We review the process of developing contextualized models, nonparametric inference from contextualized models, and identifiability conditions of contextualized models. Finally, we present the open-source PyTorch package ContextualizedML.</description><identifier>DOI: 10.48550/arxiv.2310.11340</identifier><language>eng</language><subject>Computer Science - Learning ; Statistics - Machine Learning</subject><creationdate>2023-10</creationdate><rights>http://creativecommons.org/licenses/by-nc-sa/4.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-a1150-803401dabb8fc31659e26f27741e89eade5d734078867004c1293aa57c1947873</citedby></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2310.11340$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2310.11340$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Lengerich, Benjamin</creatorcontrib><creatorcontrib>Ellington, Caleb N</creatorcontrib><creatorcontrib>Rubbi, Andrea</creatorcontrib><creatorcontrib>Kellis, Manolis</creatorcontrib><creatorcontrib>Xing, Eric P</creatorcontrib><title>Contextualized Machine Learning</title><description>We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applying deep learning to the meta-relationship between contextual information and context-specific parametric models. This is a form of varying-coefficient modeling that unifies existing frameworks including cluster analysis and cohort modeling by introducing two reusable concepts: a context encoder which translates sample context into model parameters, and sample-specific model which operates on sample predictors. We review the process of developing contextualized models, nonparametric inference from contextualized models, and identifiability conditions of contextualized models. Finally, we present the open-source PyTorch package ContextualizedML.</description><subject>Computer Science - Learning</subject><subject>Statistics - Machine Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotjssOgjAQRbtxYdAPcCU_gHZoS8vSEF8Jxo2uyVgGbYJo8BH060V0dZOTm5PD2Aj4RBql-BTrxj0noWgBgJC8z8bJpbpTc39g6d6U-xu0J1eRnxLWlauOA9YrsLzR8L8e2y_mu2QVpNvlOpmlAQIoHhje2iDHw8EUVkCkYgqjItRaApmYMCeV6_aijYk059JCGAtEpS3EUhstPDb-ebvE7Fq7M9av7JuadaniA1mZNpY</recordid><startdate>20231017</startdate><enddate>20231017</enddate><creator>Lengerich, Benjamin</creator><creator>Ellington, Caleb N</creator><creator>Rubbi, Andrea</creator><creator>Kellis, Manolis</creator><creator>Xing, Eric P</creator><scope>AKY</scope><scope>EPD</scope><scope>GOX</scope></search><sort><creationdate>20231017</creationdate><title>Contextualized Machine Learning</title><author>Lengerich, Benjamin ; Ellington, Caleb N ; Rubbi, Andrea ; Kellis, Manolis ; Xing, Eric P</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a1150-803401dabb8fc31659e26f27741e89eade5d734078867004c1293aa57c1947873</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Computer Science - Learning</topic><topic>Statistics - Machine Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>Lengerich, Benjamin</creatorcontrib><creatorcontrib>Ellington, Caleb N</creatorcontrib><creatorcontrib>Rubbi, Andrea</creatorcontrib><creatorcontrib>Kellis, Manolis</creatorcontrib><creatorcontrib>Xing, Eric P</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv Statistics</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Lengerich, Benjamin</au><au>Ellington, Caleb N</au><au>Rubbi, Andrea</au><au>Kellis, Manolis</au><au>Xing, Eric P</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Contextualized Machine Learning</atitle><date>2023-10-17</date><risdate>2023</risdate><abstract>We examine Contextualized Machine Learning (ML), a paradigm for learning heterogeneous and context-dependent effects. Contextualized ML estimates heterogeneous functions by applying deep learning to the meta-relationship between contextual information and context-specific parametric models. This is a form of varying-coefficient modeling that unifies existing frameworks including cluster analysis and cohort modeling by introducing two reusable concepts: a context encoder which translates sample context into model parameters, and sample-specific model which operates on sample predictors. We review the process of developing contextualized models, nonparametric inference from contextualized models, and identifiability conditions of contextualized models. Finally, we present the open-source PyTorch package ContextualizedML.</abstract><doi>10.48550/arxiv.2310.11340</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2310.11340
ispartof
issn
language eng
recordid cdi_arxiv_primary_2310_11340
source arXiv.org
subjects Computer Science - Learning
Statistics - Machine Learning
title Contextualized Machine Learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-10T13%3A36%3A42IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Contextualized%20Machine%20Learning&rft.au=Lengerich,%20Benjamin&rft.date=2023-10-17&rft_id=info:doi/10.48550/arxiv.2310.11340&rft_dat=%3Carxiv_GOX%3E2310_11340%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true