TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation
Deep inertial sequence learning has shown promising odometric resolution over model-based approaches for trajectory estimation in GPS-denied environments. However, existing neural inertial dead-reckoning frameworks are not suitable for real-time deployment on ultra-resource-constrained (URC) devices...
Gespeichert in:
Veröffentlicht in: | Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies mobile, wearable and ubiquitous technologies, 2022-07, Vol.6 (2), p.1-32, Article 71 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 32 |
---|---|
container_issue | 2 |
container_start_page | 1 |
container_title | Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies |
container_volume | 6 |
creator | Saha, Swapnil Sayan Sandha, Sandeep Singh Garcia, Luis Antonio Srivastava, Mani |
description | Deep inertial sequence learning has shown promising odometric resolution over model-based approaches for trajectory estimation in GPS-denied environments. However, existing neural inertial dead-reckoning frameworks are not suitable for real-time deployment on ultra-resource-constrained (URC) devices due to substantial memory, power, and compute bounds. Current deep inertial odometry techniques also suffer from gravity pollution, high-frequency inertial disturbances, varying sensor orientation, heading rate singularity, and failure in altitude estimation. In this paper, we introduce TinyOdom, a framework for training and deploying neural inertial models on URC hardware. TinyOdom exploits hardware and quantization-aware Bayesian neural architecture search (NAS) and a temporal convolutional network (TCN) backbone to train lightweight models targetted towards URC devices. In addition, we propose a magnetometer, physics, and velocity-centric sequence learning formulation robust to preceding inertial perturbations. We also expand 2D sequence learning to 3D using a model-free barometric g-h filter robust to inertial and environmental variations. We evaluate TinyOdom for a wide spectrum of inertial odometry applications and target hardware against competing methods. Specifically, we consider four applications: pedestrian, animal, aerial, and underwater vehicle dead-reckoning. Across different applications, TinyOdom reduces the size of neural inertial models by 31× to 134× with 2.5m to 12m error in 60 seconds, enabling the direct deployment of models on URC devices while still maintaining or exceeding the localization resolution over the state-of-the-art. The proposed barometric filter tracks altitude within ±0.1m and is robust to inertial disturbances and ambient dynamics. Finally, our ablation study shows that the introduced magnetometer, physics, and velocity-centric sequence learning formulation significantly improve localization performance even with notably lightweight models. |
doi_str_mv | 10.1145/3534594 |
format | Article |
fullrecord | <record><control><sourceid>proquest_pubme</sourceid><recordid>TN_cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10957141</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2973997812</sourcerecordid><originalsourceid>FETCH-LOGICAL-a248t-560ce07bb7d3474b947baedff6dc8fd14f613bbf54b27b448a4cc051936be7353</originalsourceid><addsrcrecordid>eNpVkM1LxDAQxYModlkX7x686qWaNJOmOYksfsHCXtZzSNJEK22zNq2w_72R1nU9zcD85r3HQ-ic4BtCgN1SRoEJOEKzDDikguX8-GBP0CKED4wxEZQWmJ-ihBaMMC7YDCWbqt2tS9-coROn6mAX05yj18eHzfI5Xa2fXpb3q1RlUPQpy7GxmGvNSxoNtACulS2dy0tTuJKAywnV2jHQGdcAhQJjMIvWubY8Jp2ju1F3O-jGlsa2fadque2qRnU76VUl_1_a6l2--S9JsGCcAIkK15NC5z8HG3rZVMHYulat9UOQmeBUCF6QLKJXI2o6H0Jn3d6HYPnTnZy6i-TlYaw999tUBC5GQJnm7zp9fwPiXm9w</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2973997812</pqid></control><display><type>article</type><title>TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation</title><source>ACM Digital Library</source><creator>Saha, Swapnil Sayan ; Sandha, Sandeep Singh ; Garcia, Luis Antonio ; Srivastava, Mani</creator><creatorcontrib>Saha, Swapnil Sayan ; Sandha, Sandeep Singh ; Garcia, Luis Antonio ; Srivastava, Mani</creatorcontrib><description>Deep inertial sequence learning has shown promising odometric resolution over model-based approaches for trajectory estimation in GPS-denied environments. However, existing neural inertial dead-reckoning frameworks are not suitable for real-time deployment on ultra-resource-constrained (URC) devices due to substantial memory, power, and compute bounds. Current deep inertial odometry techniques also suffer from gravity pollution, high-frequency inertial disturbances, varying sensor orientation, heading rate singularity, and failure in altitude estimation. In this paper, we introduce TinyOdom, a framework for training and deploying neural inertial models on URC hardware. TinyOdom exploits hardware and quantization-aware Bayesian neural architecture search (NAS) and a temporal convolutional network (TCN) backbone to train lightweight models targetted towards URC devices. In addition, we propose a magnetometer, physics, and velocity-centric sequence learning formulation robust to preceding inertial perturbations. We also expand 2D sequence learning to 3D using a model-free barometric g-h filter robust to inertial and environmental variations. We evaluate TinyOdom for a wide spectrum of inertial odometry applications and target hardware against competing methods. Specifically, we consider four applications: pedestrian, animal, aerial, and underwater vehicle dead-reckoning. Across different applications, TinyOdom reduces the size of neural inertial models by 31× to 134× with 2.5m to 12m error in 60 seconds, enabling the direct deployment of models on URC devices while still maintaining or exceeding the localization resolution over the state-of-the-art. The proposed barometric filter tracks altitude within ±0.1m and is robust to inertial disturbances and ambient dynamics. Finally, our ablation study shows that the introduced magnetometer, physics, and velocity-centric sequence learning formulation significantly improve localization performance even with notably lightweight models.</description><identifier>ISSN: 2474-9567</identifier><identifier>EISSN: 2474-9567</identifier><identifier>DOI: 10.1145/3534594</identifier><identifier>PMID: 38515795</identifier><language>eng</language><publisher>New York, NY, USA: ACM</publisher><subject>Computer systems organization ; Computing methodologies ; Embedded and cyber-physical systems ; Embedded systems ; Machine learning ; Robotics</subject><ispartof>Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies, 2022-07, Vol.6 (2), p.1-32, Article 71</ispartof><rights>Owner/Author</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-a248t-560ce07bb7d3474b947baedff6dc8fd14f613bbf54b27b448a4cc051936be7353</cites><orcidid>0000-0002-3782-9192 ; 0000-0003-1421-1880 ; 0000-0002-5111-0694 ; 0000-0001-5357-2254</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://dl.acm.org/doi/pdf/10.1145/3534594$$EPDF$$P50$$Gacm$$Hfree_for_read</linktopdf><link.rule.ids>230,314,780,784,885,2281,27923,27924,40195,76099</link.rule.ids><backlink>$$Uhttps://www.ncbi.nlm.nih.gov/pubmed/38515795$$D View this record in MEDLINE/PubMed$$Hfree_for_read</backlink></links><search><creatorcontrib>Saha, Swapnil Sayan</creatorcontrib><creatorcontrib>Sandha, Sandeep Singh</creatorcontrib><creatorcontrib>Garcia, Luis Antonio</creatorcontrib><creatorcontrib>Srivastava, Mani</creatorcontrib><title>TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation</title><title>Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies</title><addtitle>ACM IMWUT</addtitle><addtitle>Proc ACM Interact Mob Wearable Ubiquitous Technol</addtitle><description>Deep inertial sequence learning has shown promising odometric resolution over model-based approaches for trajectory estimation in GPS-denied environments. However, existing neural inertial dead-reckoning frameworks are not suitable for real-time deployment on ultra-resource-constrained (URC) devices due to substantial memory, power, and compute bounds. Current deep inertial odometry techniques also suffer from gravity pollution, high-frequency inertial disturbances, varying sensor orientation, heading rate singularity, and failure in altitude estimation. In this paper, we introduce TinyOdom, a framework for training and deploying neural inertial models on URC hardware. TinyOdom exploits hardware and quantization-aware Bayesian neural architecture search (NAS) and a temporal convolutional network (TCN) backbone to train lightweight models targetted towards URC devices. In addition, we propose a magnetometer, physics, and velocity-centric sequence learning formulation robust to preceding inertial perturbations. We also expand 2D sequence learning to 3D using a model-free barometric g-h filter robust to inertial and environmental variations. We evaluate TinyOdom for a wide spectrum of inertial odometry applications and target hardware against competing methods. Specifically, we consider four applications: pedestrian, animal, aerial, and underwater vehicle dead-reckoning. Across different applications, TinyOdom reduces the size of neural inertial models by 31× to 134× with 2.5m to 12m error in 60 seconds, enabling the direct deployment of models on URC devices while still maintaining or exceeding the localization resolution over the state-of-the-art. The proposed barometric filter tracks altitude within ±0.1m and is robust to inertial disturbances and ambient dynamics. Finally, our ablation study shows that the introduced magnetometer, physics, and velocity-centric sequence learning formulation significantly improve localization performance even with notably lightweight models.</description><subject>Computer systems organization</subject><subject>Computing methodologies</subject><subject>Embedded and cyber-physical systems</subject><subject>Embedded systems</subject><subject>Machine learning</subject><subject>Robotics</subject><issn>2474-9567</issn><issn>2474-9567</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><recordid>eNpVkM1LxDAQxYModlkX7x686qWaNJOmOYksfsHCXtZzSNJEK22zNq2w_72R1nU9zcD85r3HQ-ic4BtCgN1SRoEJOEKzDDikguX8-GBP0CKED4wxEZQWmJ-ihBaMMC7YDCWbqt2tS9-coROn6mAX05yj18eHzfI5Xa2fXpb3q1RlUPQpy7GxmGvNSxoNtACulS2dy0tTuJKAywnV2jHQGdcAhQJjMIvWubY8Jp2ju1F3O-jGlsa2fadque2qRnU76VUl_1_a6l2--S9JsGCcAIkK15NC5z8HG3rZVMHYulat9UOQmeBUCF6QLKJXI2o6H0Jn3d6HYPnTnZy6i-TlYaw999tUBC5GQJnm7zp9fwPiXm9w</recordid><startdate>20220701</startdate><enddate>20220701</enddate><creator>Saha, Swapnil Sayan</creator><creator>Sandha, Sandeep Singh</creator><creator>Garcia, Luis Antonio</creator><creator>Srivastava, Mani</creator><general>ACM</general><scope>NPM</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7X8</scope><scope>5PM</scope><orcidid>https://orcid.org/0000-0002-3782-9192</orcidid><orcidid>https://orcid.org/0000-0003-1421-1880</orcidid><orcidid>https://orcid.org/0000-0002-5111-0694</orcidid><orcidid>https://orcid.org/0000-0001-5357-2254</orcidid></search><sort><creationdate>20220701</creationdate><title>TinyOdom</title><author>Saha, Swapnil Sayan ; Sandha, Sandeep Singh ; Garcia, Luis Antonio ; Srivastava, Mani</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a248t-560ce07bb7d3474b947baedff6dc8fd14f613bbf54b27b448a4cc051936be7353</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Computer systems organization</topic><topic>Computing methodologies</topic><topic>Embedded and cyber-physical systems</topic><topic>Embedded systems</topic><topic>Machine learning</topic><topic>Robotics</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Saha, Swapnil Sayan</creatorcontrib><creatorcontrib>Sandha, Sandeep Singh</creatorcontrib><creatorcontrib>Garcia, Luis Antonio</creatorcontrib><creatorcontrib>Srivastava, Mani</creatorcontrib><collection>PubMed</collection><collection>CrossRef</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><jtitle>Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Saha, Swapnil Sayan</au><au>Sandha, Sandeep Singh</au><au>Garcia, Luis Antonio</au><au>Srivastava, Mani</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation</atitle><jtitle>Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies</jtitle><stitle>ACM IMWUT</stitle><addtitle>Proc ACM Interact Mob Wearable Ubiquitous Technol</addtitle><date>2022-07-01</date><risdate>2022</risdate><volume>6</volume><issue>2</issue><spage>1</spage><epage>32</epage><pages>1-32</pages><artnum>71</artnum><issn>2474-9567</issn><eissn>2474-9567</eissn><abstract>Deep inertial sequence learning has shown promising odometric resolution over model-based approaches for trajectory estimation in GPS-denied environments. However, existing neural inertial dead-reckoning frameworks are not suitable for real-time deployment on ultra-resource-constrained (URC) devices due to substantial memory, power, and compute bounds. Current deep inertial odometry techniques also suffer from gravity pollution, high-frequency inertial disturbances, varying sensor orientation, heading rate singularity, and failure in altitude estimation. In this paper, we introduce TinyOdom, a framework for training and deploying neural inertial models on URC hardware. TinyOdom exploits hardware and quantization-aware Bayesian neural architecture search (NAS) and a temporal convolutional network (TCN) backbone to train lightweight models targetted towards URC devices. In addition, we propose a magnetometer, physics, and velocity-centric sequence learning formulation robust to preceding inertial perturbations. We also expand 2D sequence learning to 3D using a model-free barometric g-h filter robust to inertial and environmental variations. We evaluate TinyOdom for a wide spectrum of inertial odometry applications and target hardware against competing methods. Specifically, we consider four applications: pedestrian, animal, aerial, and underwater vehicle dead-reckoning. Across different applications, TinyOdom reduces the size of neural inertial models by 31× to 134× with 2.5m to 12m error in 60 seconds, enabling the direct deployment of models on URC devices while still maintaining or exceeding the localization resolution over the state-of-the-art. The proposed barometric filter tracks altitude within ±0.1m and is robust to inertial disturbances and ambient dynamics. Finally, our ablation study shows that the introduced magnetometer, physics, and velocity-centric sequence learning formulation significantly improve localization performance even with notably lightweight models.</abstract><cop>New York, NY, USA</cop><pub>ACM</pub><pmid>38515795</pmid><doi>10.1145/3534594</doi><tpages>32</tpages><orcidid>https://orcid.org/0000-0002-3782-9192</orcidid><orcidid>https://orcid.org/0000-0003-1421-1880</orcidid><orcidid>https://orcid.org/0000-0002-5111-0694</orcidid><orcidid>https://orcid.org/0000-0001-5357-2254</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2474-9567 |
ispartof | Proceedings of ACM on interactive, mobile, wearable and ubiquitous technologies, 2022-07, Vol.6 (2), p.1-32, Article 71 |
issn | 2474-9567 2474-9567 |
language | eng |
recordid | cdi_pubmedcentral_primary_oai_pubmedcentral_nih_gov_10957141 |
source | ACM Digital Library |
subjects | Computer systems organization Computing methodologies Embedded and cyber-physical systems Embedded systems Machine learning Robotics |
title | TinyOdom: Hardware-Aware Efficient Neural Inertial Navigation |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-08T09%3A45%3A46IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_pubme&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=TinyOdom:%20Hardware-Aware%20Efficient%20Neural%20Inertial%20Navigation&rft.jtitle=Proceedings%20of%20ACM%20on%20interactive,%20mobile,%20wearable%20and%20ubiquitous%20technologies&rft.au=Saha,%20Swapnil%20Sayan&rft.date=2022-07-01&rft.volume=6&rft.issue=2&rft.spage=1&rft.epage=32&rft.pages=1-32&rft.artnum=71&rft.issn=2474-9567&rft.eissn=2474-9567&rft_id=info:doi/10.1145/3534594&rft_dat=%3Cproquest_pubme%3E2973997812%3C/proquest_pubme%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2973997812&rft_id=info:pmid/38515795&rfr_iscdi=true |