Image stitching based on angle-consistent warping

•Angle features are discovered as geometric constraints for image warping.•A stitching framework incorporating the angles is proposed to improve the alignment of images.•We reveal that angles can provide guidance for homography as coordinates do.•A novel constraint on mesh angles makes stitching res...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Pattern recognition 2021-09, Vol.117, p.107993, Article 107993
Hauptverfasser: Chen, Yinqi, Zheng, Huicheng, Ma, Yiyan, Yan, Zhiwei
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page 107993
container_title Pattern recognition
container_volume 117
creator Chen, Yinqi
Zheng, Huicheng
Ma, Yiyan
Yan, Zhiwei
description •Angle features are discovered as geometric constraints for image warping.•A stitching framework incorporating the angles is proposed to improve the alignment of images.•We reveal that angles can provide guidance for homography as coordinates do.•A novel constraint on mesh angles makes stitching results in non-overlapping areas more natural.•The proposed framework exhibits superior performance, especially in areas with small objects or few feature points. Many warping methods for image stitching have been proposed to construct panoramic image mosaics free of artifacts. Existing methods heavily rely on coordinate correspondences between keypoints in stitching, which may not provide adequate constraints for alignment. In this paper, we discover and employ a new constraint — angle correspondences to address the above problem. The angle of a feature point represents the local directional structure of the point, which is an extension to its position and customarily ignored in image stitching. We propose to jointly consider the coordinates as well as the angles in keypoint correspondences. Such a strategy helps to generate a correct warping in the overlapping regions of the stitched image. In addition, we propose a novel constraint — mesh angle preservation to prevent undesired distortion in non-overlapping areas. Experiments in several challenging cases demonstrate that our method yields more accurate results with significantly less artifacts in comparison with state-of-the-art methods.
doi_str_mv 10.1016/j.patcog.2021.107993
format Article
fullrecord <record><control><sourceid>elsevier_webof</sourceid><recordid>TN_cdi_webofscience_primary_000658967900005CitationCount</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><els_id>S0031320321001801</els_id><sourcerecordid>S0031320321001801</sourcerecordid><originalsourceid>FETCH-LOGICAL-c306t-89e629a374158b415d9e0ed6b5ce5cda79f66541fb801f12e17806fdd930e1f63</originalsourceid><addsrcrecordid>eNqNkE1LAzEQhoMoWKv_wMPeZetks5vdXARZ_CgUvOg5ZJNJTWmTsokW_72RLR7Fy8ww8z7DvEPINYUFBcpvN4u9SjqsFxVUNLdaIdgJmdGuZWVD6-qUzAAYLVkF7JxcxLgBoG0ezAhd7tQai5hc0u_Or4tBRTRF8IXy6y2WOvjoYkKfioMa91lxSc6s2ka8OuY5eXt8eO2fy9XL07K_X5WaAU9lJ5BXQrG2pk035GAEAho-NBobbVQrLOdNTe3QAbW0Qtp2wK0xggFSy9mc1NNePYYYR7RyP7qdGr8kBfljW27kZFv-2JaT7Yx1E3bAIdioHXqNvygA8KYTvBW5gqZ3SSUXfB8-fMrozf_RrL6b1Jif8OlwlEfCuBF1kia4vy_9Bgppgs4</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Image stitching based on angle-consistent warping</title><source>Elsevier ScienceDirect Journals Complete</source><source>Web of Science - Science Citation Index Expanded - 2021&lt;img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" /&gt;</source><creator>Chen, Yinqi ; Zheng, Huicheng ; Ma, Yiyan ; Yan, Zhiwei</creator><creatorcontrib>Chen, Yinqi ; Zheng, Huicheng ; Ma, Yiyan ; Yan, Zhiwei</creatorcontrib><description>•Angle features are discovered as geometric constraints for image warping.•A stitching framework incorporating the angles is proposed to improve the alignment of images.•We reveal that angles can provide guidance for homography as coordinates do.•A novel constraint on mesh angles makes stitching results in non-overlapping areas more natural.•The proposed framework exhibits superior performance, especially in areas with small objects or few feature points. Many warping methods for image stitching have been proposed to construct panoramic image mosaics free of artifacts. Existing methods heavily rely on coordinate correspondences between keypoints in stitching, which may not provide adequate constraints for alignment. In this paper, we discover and employ a new constraint — angle correspondences to address the above problem. The angle of a feature point represents the local directional structure of the point, which is an extension to its position and customarily ignored in image stitching. We propose to jointly consider the coordinates as well as the angles in keypoint correspondences. Such a strategy helps to generate a correct warping in the overlapping regions of the stitched image. In addition, we propose a novel constraint — mesh angle preservation to prevent undesired distortion in non-overlapping areas. Experiments in several challenging cases demonstrate that our method yields more accurate results with significantly less artifacts in comparison with state-of-the-art methods.</description><identifier>ISSN: 0031-3203</identifier><identifier>EISSN: 1873-5142</identifier><identifier>DOI: 10.1016/j.patcog.2021.107993</identifier><language>eng</language><publisher>OXFORD: Elsevier Ltd</publisher><subject>Angle features ; Computer Science ; Computer Science, Artificial Intelligence ; Engineering ; Engineering, Electrical &amp; Electronic ; Homography estimation ; Image alignment ; Image stitching ; Science &amp; Technology ; Technology</subject><ispartof>Pattern recognition, 2021-09, Vol.117, p.107993, Article 107993</ispartof><rights>2021 Elsevier Ltd</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>true</woscitedreferencessubscribed><woscitedreferencescount>8</woscitedreferencescount><woscitedreferencesoriginalsourcerecordid>wos000658967900005</woscitedreferencesoriginalsourcerecordid><citedby>FETCH-LOGICAL-c306t-89e629a374158b415d9e0ed6b5ce5cda79f66541fb801f12e17806fdd930e1f63</citedby><cites>FETCH-LOGICAL-c306t-89e629a374158b415d9e0ed6b5ce5cda79f66541fb801f12e17806fdd930e1f63</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://dx.doi.org/10.1016/j.patcog.2021.107993$$EHTML$$P50$$Gelsevier$$H</linktohtml><link.rule.ids>315,781,785,3551,27929,27930,39263,46000</link.rule.ids></links><search><creatorcontrib>Chen, Yinqi</creatorcontrib><creatorcontrib>Zheng, Huicheng</creatorcontrib><creatorcontrib>Ma, Yiyan</creatorcontrib><creatorcontrib>Yan, Zhiwei</creatorcontrib><title>Image stitching based on angle-consistent warping</title><title>Pattern recognition</title><addtitle>PATTERN RECOGN</addtitle><description>•Angle features are discovered as geometric constraints for image warping.•A stitching framework incorporating the angles is proposed to improve the alignment of images.•We reveal that angles can provide guidance for homography as coordinates do.•A novel constraint on mesh angles makes stitching results in non-overlapping areas more natural.•The proposed framework exhibits superior performance, especially in areas with small objects or few feature points. Many warping methods for image stitching have been proposed to construct panoramic image mosaics free of artifacts. Existing methods heavily rely on coordinate correspondences between keypoints in stitching, which may not provide adequate constraints for alignment. In this paper, we discover and employ a new constraint — angle correspondences to address the above problem. The angle of a feature point represents the local directional structure of the point, which is an extension to its position and customarily ignored in image stitching. We propose to jointly consider the coordinates as well as the angles in keypoint correspondences. Such a strategy helps to generate a correct warping in the overlapping regions of the stitched image. In addition, we propose a novel constraint — mesh angle preservation to prevent undesired distortion in non-overlapping areas. Experiments in several challenging cases demonstrate that our method yields more accurate results with significantly less artifacts in comparison with state-of-the-art methods.</description><subject>Angle features</subject><subject>Computer Science</subject><subject>Computer Science, Artificial Intelligence</subject><subject>Engineering</subject><subject>Engineering, Electrical &amp; Electronic</subject><subject>Homography estimation</subject><subject>Image alignment</subject><subject>Image stitching</subject><subject>Science &amp; Technology</subject><subject>Technology</subject><issn>0031-3203</issn><issn>1873-5142</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>HGBXW</sourceid><recordid>eNqNkE1LAzEQhoMoWKv_wMPeZetks5vdXARZ_CgUvOg5ZJNJTWmTsokW_72RLR7Fy8ww8z7DvEPINYUFBcpvN4u9SjqsFxVUNLdaIdgJmdGuZWVD6-qUzAAYLVkF7JxcxLgBoG0ezAhd7tQai5hc0u_Or4tBRTRF8IXy6y2WOvjoYkKfioMa91lxSc6s2ka8OuY5eXt8eO2fy9XL07K_X5WaAU9lJ5BXQrG2pk035GAEAho-NBobbVQrLOdNTe3QAbW0Qtp2wK0xggFSy9mc1NNePYYYR7RyP7qdGr8kBfljW27kZFv-2JaT7Yx1E3bAIdioHXqNvygA8KYTvBW5gqZ3SSUXfB8-fMrozf_RrL6b1Jif8OlwlEfCuBF1kia4vy_9Bgppgs4</recordid><startdate>202109</startdate><enddate>202109</enddate><creator>Chen, Yinqi</creator><creator>Zheng, Huicheng</creator><creator>Ma, Yiyan</creator><creator>Yan, Zhiwei</creator><general>Elsevier Ltd</general><general>Elsevier</general><scope>BLEPL</scope><scope>DTL</scope><scope>HGBXW</scope><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>202109</creationdate><title>Image stitching based on angle-consistent warping</title><author>Chen, Yinqi ; Zheng, Huicheng ; Ma, Yiyan ; Yan, Zhiwei</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c306t-89e629a374158b415d9e0ed6b5ce5cda79f66541fb801f12e17806fdd930e1f63</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Angle features</topic><topic>Computer Science</topic><topic>Computer Science, Artificial Intelligence</topic><topic>Engineering</topic><topic>Engineering, Electrical &amp; Electronic</topic><topic>Homography estimation</topic><topic>Image alignment</topic><topic>Image stitching</topic><topic>Science &amp; Technology</topic><topic>Technology</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Chen, Yinqi</creatorcontrib><creatorcontrib>Zheng, Huicheng</creatorcontrib><creatorcontrib>Ma, Yiyan</creatorcontrib><creatorcontrib>Yan, Zhiwei</creatorcontrib><collection>Web of Science Core Collection</collection><collection>Science Citation Index Expanded</collection><collection>Web of Science - Science Citation Index Expanded - 2021</collection><collection>CrossRef</collection><jtitle>Pattern recognition</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Chen, Yinqi</au><au>Zheng, Huicheng</au><au>Ma, Yiyan</au><au>Yan, Zhiwei</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Image stitching based on angle-consistent warping</atitle><jtitle>Pattern recognition</jtitle><stitle>PATTERN RECOGN</stitle><date>2021-09</date><risdate>2021</risdate><volume>117</volume><spage>107993</spage><pages>107993-</pages><artnum>107993</artnum><issn>0031-3203</issn><eissn>1873-5142</eissn><abstract>•Angle features are discovered as geometric constraints for image warping.•A stitching framework incorporating the angles is proposed to improve the alignment of images.•We reveal that angles can provide guidance for homography as coordinates do.•A novel constraint on mesh angles makes stitching results in non-overlapping areas more natural.•The proposed framework exhibits superior performance, especially in areas with small objects or few feature points. Many warping methods for image stitching have been proposed to construct panoramic image mosaics free of artifacts. Existing methods heavily rely on coordinate correspondences between keypoints in stitching, which may not provide adequate constraints for alignment. In this paper, we discover and employ a new constraint — angle correspondences to address the above problem. The angle of a feature point represents the local directional structure of the point, which is an extension to its position and customarily ignored in image stitching. We propose to jointly consider the coordinates as well as the angles in keypoint correspondences. Such a strategy helps to generate a correct warping in the overlapping regions of the stitched image. In addition, we propose a novel constraint — mesh angle preservation to prevent undesired distortion in non-overlapping areas. Experiments in several challenging cases demonstrate that our method yields more accurate results with significantly less artifacts in comparison with state-of-the-art methods.</abstract><cop>OXFORD</cop><pub>Elsevier Ltd</pub><doi>10.1016/j.patcog.2021.107993</doi><tpages>11</tpages></addata></record>
fulltext fulltext
identifier ISSN: 0031-3203
ispartof Pattern recognition, 2021-09, Vol.117, p.107993, Article 107993
issn 0031-3203
1873-5142
language eng
recordid cdi_webofscience_primary_000658967900005CitationCount
source Elsevier ScienceDirect Journals Complete; Web of Science - Science Citation Index Expanded - 2021<img src="https://exlibris-pub.s3.amazonaws.com/fromwos-v2.jpg" />
subjects Angle features
Computer Science
Computer Science, Artificial Intelligence
Engineering
Engineering, Electrical & Electronic
Homography estimation
Image alignment
Image stitching
Science & Technology
Technology
title Image stitching based on angle-consistent warping
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-12T07%3A36%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-elsevier_webof&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Image%20stitching%20based%20on%20angle-consistent%20warping&rft.jtitle=Pattern%20recognition&rft.au=Chen,%20Yinqi&rft.date=2021-09&rft.volume=117&rft.spage=107993&rft.pages=107993-&rft.artnum=107993&rft.issn=0031-3203&rft.eissn=1873-5142&rft_id=info:doi/10.1016/j.patcog.2021.107993&rft_dat=%3Celsevier_webof%3ES0031320321001801%3C/elsevier_webof%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rft_els_id=S0031320321001801&rfr_iscdi=true