Scalable Deployment of AI Time-series Models for IoT

Workshop AI for Internet of Things, IJCAI 2019 IBM Research Castor, a cloud-native system for managing and deploying large numbers of AI time-series models in IoT applications, is described. Modelling code templates, in Python and R, following a typical machine-learning workflow are supported. A kno...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: Eck, Bradley, Fusco, Francesco, Gormally, Robert, Purcell, Mark, Tirupathi, Seshu
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator Eck, Bradley
Fusco, Francesco
Gormally, Robert
Purcell, Mark
Tirupathi, Seshu
description Workshop AI for Internet of Things, IJCAI 2019 IBM Research Castor, a cloud-native system for managing and deploying large numbers of AI time-series models in IoT applications, is described. Modelling code templates, in Python and R, following a typical machine-learning workflow are supported. A knowledge-based approach to managing model and time-series data allows the use of general semantic concepts for expressing feature engineering tasks. Model templates can be programmatically deployed against specific instances of semantic concepts, thus supporting model reuse and automated replication as the IoT application grows. Deployed models are automatically executed in parallel leveraging a serverless cloud computing framework. The complete history of trained model versions and rolling-horizon predictions is persisted, thus enabling full model lineage and traceability. Results from deployments in real-world smart-grid live forecasting applications are reported. Scalability of executing up to tens of thousands of AI modelling tasks is also evaluated.
doi_str_mv 10.48550/arxiv.2003.12141
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_2003_12141</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2003_12141</sourcerecordid><originalsourceid>FETCH-LOGICAL-a671-63ad45631fc301699183b200f860529036f638b1e959e36a7fccc3d90af3f1a13</originalsourceid><addsrcrecordid>eNotzstOwzAQhWFvukCFB2CFXyDBk4ndeFmVW6QiFmQfTZwZKZKDK6eq2rcHCquz-8-n1D2Ysm6sNY-Uz9OprIzBEiqo4UbVn4EiDZH1Ex9iusz8ddRJ9LbV3TRzsXCeeNHvaeS4aElZt6m7VSuhuPDd_65V9_Lc7d6K_cdru9vuC3IbKBzSWFuHIAENOO-hweHnWxpnbOUNOnHYDMDeekZHGwkh4OgNCQoQ4Fo9_GWv7P6Qp5nypf_l91c-fgNVhD1I</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Scalable Deployment of AI Time-series Models for IoT</title><source>arXiv.org</source><creator>Eck, Bradley ; Fusco, Francesco ; Gormally, Robert ; Purcell, Mark ; Tirupathi, Seshu</creator><creatorcontrib>Eck, Bradley ; Fusco, Francesco ; Gormally, Robert ; Purcell, Mark ; Tirupathi, Seshu</creatorcontrib><description>Workshop AI for Internet of Things, IJCAI 2019 IBM Research Castor, a cloud-native system for managing and deploying large numbers of AI time-series models in IoT applications, is described. Modelling code templates, in Python and R, following a typical machine-learning workflow are supported. A knowledge-based approach to managing model and time-series data allows the use of general semantic concepts for expressing feature engineering tasks. Model templates can be programmatically deployed against specific instances of semantic concepts, thus supporting model reuse and automated replication as the IoT application grows. Deployed models are automatically executed in parallel leveraging a serverless cloud computing framework. The complete history of trained model versions and rolling-horizon predictions is persisted, thus enabling full model lineage and traceability. Results from deployments in real-world smart-grid live forecasting applications are reported. Scalability of executing up to tens of thousands of AI modelling tasks is also evaluated.</description><identifier>DOI: 10.48550/arxiv.2003.12141</identifier><language>eng</language><subject>Computer Science - Artificial Intelligence ; Computer Science - Computers and Society ; Computer Science - Distributed, Parallel, and Cluster Computing</subject><creationdate>2020-03</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/2003.12141$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.2003.12141$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>Eck, Bradley</creatorcontrib><creatorcontrib>Fusco, Francesco</creatorcontrib><creatorcontrib>Gormally, Robert</creatorcontrib><creatorcontrib>Purcell, Mark</creatorcontrib><creatorcontrib>Tirupathi, Seshu</creatorcontrib><title>Scalable Deployment of AI Time-series Models for IoT</title><description>Workshop AI for Internet of Things, IJCAI 2019 IBM Research Castor, a cloud-native system for managing and deploying large numbers of AI time-series models in IoT applications, is described. Modelling code templates, in Python and R, following a typical machine-learning workflow are supported. A knowledge-based approach to managing model and time-series data allows the use of general semantic concepts for expressing feature engineering tasks. Model templates can be programmatically deployed against specific instances of semantic concepts, thus supporting model reuse and automated replication as the IoT application grows. Deployed models are automatically executed in parallel leveraging a serverless cloud computing framework. The complete history of trained model versions and rolling-horizon predictions is persisted, thus enabling full model lineage and traceability. Results from deployments in real-world smart-grid live forecasting applications are reported. Scalability of executing up to tens of thousands of AI modelling tasks is also evaluated.</description><subject>Computer Science - Artificial Intelligence</subject><subject>Computer Science - Computers and Society</subject><subject>Computer Science - Distributed, Parallel, and Cluster Computing</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotzstOwzAQhWFvukCFB2CFXyDBk4ndeFmVW6QiFmQfTZwZKZKDK6eq2rcHCquz-8-n1D2Ysm6sNY-Uz9OprIzBEiqo4UbVn4EiDZH1Ex9iusz8ddRJ9LbV3TRzsXCeeNHvaeS4aElZt6m7VSuhuPDd_65V9_Lc7d6K_cdru9vuC3IbKBzSWFuHIAENOO-hweHnWxpnbOUNOnHYDMDeekZHGwkh4OgNCQoQ4Fo9_GWv7P6Qp5nypf_l91c-fgNVhD1I</recordid><startdate>20200324</startdate><enddate>20200324</enddate><creator>Eck, Bradley</creator><creator>Fusco, Francesco</creator><creator>Gormally, Robert</creator><creator>Purcell, Mark</creator><creator>Tirupathi, Seshu</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20200324</creationdate><title>Scalable Deployment of AI Time-series Models for IoT</title><author>Eck, Bradley ; Fusco, Francesco ; Gormally, Robert ; Purcell, Mark ; Tirupathi, Seshu</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a671-63ad45631fc301699183b200f860529036f638b1e959e36a7fccc3d90af3f1a13</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Computer Science - Artificial Intelligence</topic><topic>Computer Science - Computers and Society</topic><topic>Computer Science - Distributed, Parallel, and Cluster Computing</topic><toplevel>online_resources</toplevel><creatorcontrib>Eck, Bradley</creatorcontrib><creatorcontrib>Fusco, Francesco</creatorcontrib><creatorcontrib>Gormally, Robert</creatorcontrib><creatorcontrib>Purcell, Mark</creatorcontrib><creatorcontrib>Tirupathi, Seshu</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Eck, Bradley</au><au>Fusco, Francesco</au><au>Gormally, Robert</au><au>Purcell, Mark</au><au>Tirupathi, Seshu</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Scalable Deployment of AI Time-series Models for IoT</atitle><date>2020-03-24</date><risdate>2020</risdate><abstract>Workshop AI for Internet of Things, IJCAI 2019 IBM Research Castor, a cloud-native system for managing and deploying large numbers of AI time-series models in IoT applications, is described. Modelling code templates, in Python and R, following a typical machine-learning workflow are supported. A knowledge-based approach to managing model and time-series data allows the use of general semantic concepts for expressing feature engineering tasks. Model templates can be programmatically deployed against specific instances of semantic concepts, thus supporting model reuse and automated replication as the IoT application grows. Deployed models are automatically executed in parallel leveraging a serverless cloud computing framework. The complete history of trained model versions and rolling-horizon predictions is persisted, thus enabling full model lineage and traceability. Results from deployments in real-world smart-grid live forecasting applications are reported. Scalability of executing up to tens of thousands of AI modelling tasks is also evaluated.</abstract><doi>10.48550/arxiv.2003.12141</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.2003.12141
ispartof
issn
language eng
recordid cdi_arxiv_primary_2003_12141
source arXiv.org
subjects Computer Science - Artificial Intelligence
Computer Science - Computers and Society
Computer Science - Distributed, Parallel, and Cluster Computing
title Scalable Deployment of AI Time-series Models for IoT
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-24T01%3A17%3A27IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Scalable%20Deployment%20of%20AI%20Time-series%20Models%20for%20IoT&rft.au=Eck,%20Bradley&rft.date=2020-03-24&rft_id=info:doi/10.48550/arxiv.2003.12141&rft_dat=%3Carxiv_GOX%3E2003_12141%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true