RoadTagger: Robust Road Attribute Inference with Graph Neural Networks

Inferring road attributes such as lane count and road type from satellite imagery is challenging. Often, due to the occlusion in satellite imagery and the spatial correlation of road attributes, a road attribute at one position on a road may only be apparent when considering far-away segments of the...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: He, Songtao, Bastani, Favyen, Jagwani, Satvat, Park, Edward, Abbar, Sofiane, Alizadeh, Mohammad, Balakrishnan, Hari, Chawla, Sanjay, Madden, Samuel, Sadeghi, Mohammad Amin
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator He, Songtao
Bastani, Favyen
Jagwani, Satvat
Park, Edward
Abbar, Sofiane
Alizadeh, Mohammad
Balakrishnan, Hari
Chawla, Sanjay
Madden, Samuel
Sadeghi, Mohammad Amin
description Inferring road attributes such as lane count and road type from satellite imagery is challenging. Often, due to the occlusion in satellite imagery and the spatial correlation of road attributes, a road attribute at one position on a road may only be apparent when considering far-away segments of the road. Thus, to robustly infer road attributes, the model must integrate scattered information and capture the spatial correlation of features along roads. Existing solutions that rely on image classifiers fail to capture this correlation, resulting in poor accuracy. We find this failure is caused by a fundamental limitation -- the limited effective receptive field of image classifiers. To overcome this limitation, we propose RoadTagger, an end-to-end architecture which combines both Convolutional Neural Networks (CNNs) and Graph Neural Networks (GNNs) to infer road attributes. The usage of graph neural networks allows information propagation on the road network graph and eliminates the receptive field limitation of image classifiers. We evaluate RoadTagger on both a large real-world dataset covering 688 km^2 area in 20 U.S. cities and a synthesized micro-dataset. In the evaluation, RoadTagger improves inference accuracy over the CNN image classifier based approaches. RoadTagger also demonstrates strong robustness against different disruptions in the satellite imagery and the ability to learn complicated inductive rules for aggregating scattered information along the road network.
doi_str_mv 10.48550/arxiv.1912.12408
format Article
fullrecord <record><control><sourceid>arxiv_GOX</sourceid><recordid>TN_cdi_arxiv_primary_1912_12408</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1912_12408</sourcerecordid><originalsourceid>FETCH-LOGICAL-a678-bc48370fab2c9c237da79c0dc3667d8c2b6dc5151f1d5044e0fd3483aa679bf53</originalsourceid><addsrcrecordid>eNotj8tKw0AYRmfjQqoP4Mp5gcS5ZibuSrG1UBRK9uGfWxusTfkzsfr2ptXVgQ_OB4eQB85KZbVmT4Df3VfJay5KLhSzt2S57SE0sNtFfKbb3o1DppeJznPGzo050vUxRYxHH-m5y3u6Qjjt6VscEQ4T8rnHj-GO3CQ4DPH-nzPSLF-axWuxeV-tF_NNAZWxhfPKSsMSOOFrL6QJYGrPgpdVZYL1wlXBa6554kEzpSJLQU4KTHbtkpYz8vh3ew1pT9h9Av60l6D2GiR_Ad1KRfs</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>RoadTagger: Robust Road Attribute Inference with Graph Neural Networks</title><source>arXiv.org</source><creator>He, Songtao ; Bastani, Favyen ; Jagwani, Satvat ; Park, Edward ; Abbar, Sofiane ; Alizadeh, Mohammad ; Balakrishnan, Hari ; Chawla, Sanjay ; Madden, Samuel ; Sadeghi, Mohammad Amin</creator><creatorcontrib>He, Songtao ; Bastani, Favyen ; Jagwani, Satvat ; Park, Edward ; Abbar, Sofiane ; Alizadeh, Mohammad ; Balakrishnan, Hari ; Chawla, Sanjay ; Madden, Samuel ; Sadeghi, Mohammad Amin</creatorcontrib><description>Inferring road attributes such as lane count and road type from satellite imagery is challenging. Often, due to the occlusion in satellite imagery and the spatial correlation of road attributes, a road attribute at one position on a road may only be apparent when considering far-away segments of the road. Thus, to robustly infer road attributes, the model must integrate scattered information and capture the spatial correlation of features along roads. Existing solutions that rely on image classifiers fail to capture this correlation, resulting in poor accuracy. We find this failure is caused by a fundamental limitation -- the limited effective receptive field of image classifiers. To overcome this limitation, we propose RoadTagger, an end-to-end architecture which combines both Convolutional Neural Networks (CNNs) and Graph Neural Networks (GNNs) to infer road attributes. The usage of graph neural networks allows information propagation on the road network graph and eliminates the receptive field limitation of image classifiers. We evaluate RoadTagger on both a large real-world dataset covering 688 km^2 area in 20 U.S. cities and a synthesized micro-dataset. In the evaluation, RoadTagger improves inference accuracy over the CNN image classifier based approaches. RoadTagger also demonstrates strong robustness against different disruptions in the satellite imagery and the ability to learn complicated inductive rules for aggregating scattered information along the road network.</description><identifier>DOI: 10.48550/arxiv.1912.12408</identifier><language>eng</language><subject>Computer Science - Computer Vision and Pattern Recognition ; Computer Science - Learning</subject><creationdate>2019-12</creationdate><rights>http://arxiv.org/licenses/nonexclusive-distrib/1.0</rights><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>228,230,780,885</link.rule.ids><linktorsrc>$$Uhttps://arxiv.org/abs/1912.12408$$EView_record_in_Cornell_University$$FView_record_in_$$GCornell_University$$Hfree_for_read</linktorsrc><backlink>$$Uhttps://doi.org/10.48550/arXiv.1912.12408$$DView paper in arXiv$$Hfree_for_read</backlink></links><search><creatorcontrib>He, Songtao</creatorcontrib><creatorcontrib>Bastani, Favyen</creatorcontrib><creatorcontrib>Jagwani, Satvat</creatorcontrib><creatorcontrib>Park, Edward</creatorcontrib><creatorcontrib>Abbar, Sofiane</creatorcontrib><creatorcontrib>Alizadeh, Mohammad</creatorcontrib><creatorcontrib>Balakrishnan, Hari</creatorcontrib><creatorcontrib>Chawla, Sanjay</creatorcontrib><creatorcontrib>Madden, Samuel</creatorcontrib><creatorcontrib>Sadeghi, Mohammad Amin</creatorcontrib><title>RoadTagger: Robust Road Attribute Inference with Graph Neural Networks</title><description>Inferring road attributes such as lane count and road type from satellite imagery is challenging. Often, due to the occlusion in satellite imagery and the spatial correlation of road attributes, a road attribute at one position on a road may only be apparent when considering far-away segments of the road. Thus, to robustly infer road attributes, the model must integrate scattered information and capture the spatial correlation of features along roads. Existing solutions that rely on image classifiers fail to capture this correlation, resulting in poor accuracy. We find this failure is caused by a fundamental limitation -- the limited effective receptive field of image classifiers. To overcome this limitation, we propose RoadTagger, an end-to-end architecture which combines both Convolutional Neural Networks (CNNs) and Graph Neural Networks (GNNs) to infer road attributes. The usage of graph neural networks allows information propagation on the road network graph and eliminates the receptive field limitation of image classifiers. We evaluate RoadTagger on both a large real-world dataset covering 688 km^2 area in 20 U.S. cities and a synthesized micro-dataset. In the evaluation, RoadTagger improves inference accuracy over the CNN image classifier based approaches. RoadTagger also demonstrates strong robustness against different disruptions in the satellite imagery and the ability to learn complicated inductive rules for aggregating scattered information along the road network.</description><subject>Computer Science - Computer Vision and Pattern Recognition</subject><subject>Computer Science - Learning</subject><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2019</creationdate><recordtype>article</recordtype><sourceid>GOX</sourceid><recordid>eNotj8tKw0AYRmfjQqoP4Mp5gcS5ZibuSrG1UBRK9uGfWxusTfkzsfr2ptXVgQ_OB4eQB85KZbVmT4Df3VfJay5KLhSzt2S57SE0sNtFfKbb3o1DppeJznPGzo050vUxRYxHH-m5y3u6Qjjt6VscEQ4T8rnHj-GO3CQ4DPH-nzPSLF-axWuxeV-tF_NNAZWxhfPKSsMSOOFrL6QJYGrPgpdVZYL1wlXBa6554kEzpSJLQU4KTHbtkpYz8vh3ew1pT9h9Av60l6D2GiR_Ad1KRfs</recordid><startdate>20191228</startdate><enddate>20191228</enddate><creator>He, Songtao</creator><creator>Bastani, Favyen</creator><creator>Jagwani, Satvat</creator><creator>Park, Edward</creator><creator>Abbar, Sofiane</creator><creator>Alizadeh, Mohammad</creator><creator>Balakrishnan, Hari</creator><creator>Chawla, Sanjay</creator><creator>Madden, Samuel</creator><creator>Sadeghi, Mohammad Amin</creator><scope>AKY</scope><scope>GOX</scope></search><sort><creationdate>20191228</creationdate><title>RoadTagger: Robust Road Attribute Inference with Graph Neural Networks</title><author>He, Songtao ; Bastani, Favyen ; Jagwani, Satvat ; Park, Edward ; Abbar, Sofiane ; Alizadeh, Mohammad ; Balakrishnan, Hari ; Chawla, Sanjay ; Madden, Samuel ; Sadeghi, Mohammad Amin</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-a678-bc48370fab2c9c237da79c0dc3667d8c2b6dc5151f1d5044e0fd3483aa679bf53</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2019</creationdate><topic>Computer Science - Computer Vision and Pattern Recognition</topic><topic>Computer Science - Learning</topic><toplevel>online_resources</toplevel><creatorcontrib>He, Songtao</creatorcontrib><creatorcontrib>Bastani, Favyen</creatorcontrib><creatorcontrib>Jagwani, Satvat</creatorcontrib><creatorcontrib>Park, Edward</creatorcontrib><creatorcontrib>Abbar, Sofiane</creatorcontrib><creatorcontrib>Alizadeh, Mohammad</creatorcontrib><creatorcontrib>Balakrishnan, Hari</creatorcontrib><creatorcontrib>Chawla, Sanjay</creatorcontrib><creatorcontrib>Madden, Samuel</creatorcontrib><creatorcontrib>Sadeghi, Mohammad Amin</creatorcontrib><collection>arXiv Computer Science</collection><collection>arXiv.org</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>He, Songtao</au><au>Bastani, Favyen</au><au>Jagwani, Satvat</au><au>Park, Edward</au><au>Abbar, Sofiane</au><au>Alizadeh, Mohammad</au><au>Balakrishnan, Hari</au><au>Chawla, Sanjay</au><au>Madden, Samuel</au><au>Sadeghi, Mohammad Amin</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>RoadTagger: Robust Road Attribute Inference with Graph Neural Networks</atitle><date>2019-12-28</date><risdate>2019</risdate><abstract>Inferring road attributes such as lane count and road type from satellite imagery is challenging. Often, due to the occlusion in satellite imagery and the spatial correlation of road attributes, a road attribute at one position on a road may only be apparent when considering far-away segments of the road. Thus, to robustly infer road attributes, the model must integrate scattered information and capture the spatial correlation of features along roads. Existing solutions that rely on image classifiers fail to capture this correlation, resulting in poor accuracy. We find this failure is caused by a fundamental limitation -- the limited effective receptive field of image classifiers. To overcome this limitation, we propose RoadTagger, an end-to-end architecture which combines both Convolutional Neural Networks (CNNs) and Graph Neural Networks (GNNs) to infer road attributes. The usage of graph neural networks allows information propagation on the road network graph and eliminates the receptive field limitation of image classifiers. We evaluate RoadTagger on both a large real-world dataset covering 688 km^2 area in 20 U.S. cities and a synthesized micro-dataset. In the evaluation, RoadTagger improves inference accuracy over the CNN image classifier based approaches. RoadTagger also demonstrates strong robustness against different disruptions in the satellite imagery and the ability to learn complicated inductive rules for aggregating scattered information along the road network.</abstract><doi>10.48550/arxiv.1912.12408</doi><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier DOI: 10.48550/arxiv.1912.12408
ispartof
issn
language eng
recordid cdi_arxiv_primary_1912_12408
source arXiv.org
subjects Computer Science - Computer Vision and Pattern Recognition
Computer Science - Learning
title RoadTagger: Robust Road Attribute Inference with Graph Neural Networks
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T00%3A32%3A50IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-arxiv_GOX&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=RoadTagger:%20Robust%20Road%20Attribute%20Inference%20with%20Graph%20Neural%20Networks&rft.au=He,%20Songtao&rft.date=2019-12-28&rft_id=info:doi/10.48550/arxiv.1912.12408&rft_dat=%3Carxiv_GOX%3E1912_12408%3C/arxiv_GOX%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true