PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring

Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur ima...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2021, Vol.9, p.105131-105143
1. Verfasser: Zhang, Zhenfeng
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 105143
container_issue
container_start_page 105131
container_title IEEE access
container_volume 9
creator Zhang, Zhenfeng
description Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.
doi_str_mv 10.1109/ACCESS.2021.3099803
format Article
fullrecord <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9495812</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9495812</ieee_id><doaj_id>oai_doaj_org_article_2fd23bcc3d7745d882c4649ad76f8d0f</doaj_id><sourcerecordid>2556486088</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</originalsourceid><addsrcrecordid>eNpNkV9v2yAUxa1plVZ1_QR9QdqzM8wfG_ZmZV0WqWkrZXtGGK4zsti016RTvv1oXVXlBXQ453dBpyiuKrqoKqq_tsvl9Xa7YJRVC061VpR_KM5ZVeuSS15_fHf-VFxO057mpbIkm_Pi8b7dbFft7Tdyf0I7BE_alGBMIY5kA-6PHcM0lHcYsgaebE_DAAlPZAUjoE3hCUjrnwAni8EeyC2kfxH_kj4i2cQXynqwOyDfoTscEcO4-1yc9fYwweXrflH8_nH9a_mzvLlbrZftTekEVan0HLiy1nqhpa5BcNfV2vfedR68l1R0wnWqBu4r1vtsFI0WzOp8IbXkjF8U65nro92bBwyDxZOJNpgXIeLOWEzBHcBkAOOdc9w3jZBeKeZELbT1Td0rT_vM-jKzHjA-HmFKZh-POObnGyZlLVRNlcouPrscxmlC6N-mVtQ8V2XmqsxzVea1qpy6mlMBAN4SOn9bVYz_B9UrkS0</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2556486088</pqid></control><display><type>article</type><title>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Zhang, Zhenfeng</creator><creatorcontrib>Zhang, Zhenfeng</creatorcontrib><description>Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2021.3099803</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Blurring ; Cameras ; Convolutional neural networks ; CycleGAN ; Feature extraction ; Generative adversarial networks ; Image acquisition ; Image enhancement ; Image quality ; Image resolution ; Image restoration ; Kernel ; Motion image deblurring ; Motion stability ; Neural networks ; Object motion ; Object recognition ; pyramid attention mechanism ; RMSProp ; Symmetry ; symmetry generative adversarial network ; Training ; Vibration</subject><ispartof>IEEE access, 2021, Vol.9, p.105131-105143</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</citedby><cites>FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</cites><orcidid>0000-0001-7621-0360</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9495812$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Zhang, Zhenfeng</creatorcontrib><title>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</title><title>IEEE access</title><addtitle>Access</addtitle><description>Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.</description><subject>Algorithms</subject><subject>Blurring</subject><subject>Cameras</subject><subject>Convolutional neural networks</subject><subject>CycleGAN</subject><subject>Feature extraction</subject><subject>Generative adversarial networks</subject><subject>Image acquisition</subject><subject>Image enhancement</subject><subject>Image quality</subject><subject>Image resolution</subject><subject>Image restoration</subject><subject>Kernel</subject><subject>Motion image deblurring</subject><subject>Motion stability</subject><subject>Neural networks</subject><subject>Object motion</subject><subject>Object recognition</subject><subject>pyramid attention mechanism</subject><subject>RMSProp</subject><subject>Symmetry</subject><subject>symmetry generative adversarial network</subject><subject>Training</subject><subject>Vibration</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkV9v2yAUxa1plVZ1_QR9QdqzM8wfG_ZmZV0WqWkrZXtGGK4zsti016RTvv1oXVXlBXQ453dBpyiuKrqoKqq_tsvl9Xa7YJRVC061VpR_KM5ZVeuSS15_fHf-VFxO057mpbIkm_Pi8b7dbFft7Tdyf0I7BE_alGBMIY5kA-6PHcM0lHcYsgaebE_DAAlPZAUjoE3hCUjrnwAni8EeyC2kfxH_kj4i2cQXynqwOyDfoTscEcO4-1yc9fYwweXrflH8_nH9a_mzvLlbrZftTekEVan0HLiy1nqhpa5BcNfV2vfedR68l1R0wnWqBu4r1vtsFI0WzOp8IbXkjF8U65nro92bBwyDxZOJNpgXIeLOWEzBHcBkAOOdc9w3jZBeKeZELbT1Td0rT_vM-jKzHjA-HmFKZh-POObnGyZlLVRNlcouPrscxmlC6N-mVtQ8V2XmqsxzVea1qpy6mlMBAN4SOn9bVYz_B9UrkS0</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Zhang, Zhenfeng</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0001-7621-0360</orcidid></search><sort><creationdate>2021</creationdate><title>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</title><author>Zhang, Zhenfeng</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Blurring</topic><topic>Cameras</topic><topic>Convolutional neural networks</topic><topic>CycleGAN</topic><topic>Feature extraction</topic><topic>Generative adversarial networks</topic><topic>Image acquisition</topic><topic>Image enhancement</topic><topic>Image quality</topic><topic>Image resolution</topic><topic>Image restoration</topic><topic>Kernel</topic><topic>Motion image deblurring</topic><topic>Motion stability</topic><topic>Neural networks</topic><topic>Object motion</topic><topic>Object recognition</topic><topic>pyramid attention mechanism</topic><topic>RMSProp</topic><topic>Symmetry</topic><topic>symmetry generative adversarial network</topic><topic>Training</topic><topic>Vibration</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Zhenfeng</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Zhenfeng</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2021</date><risdate>2021</risdate><volume>9</volume><spage>105131</spage><epage>105143</epage><pages>105131-105143</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2021.3099803</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-7621-0360</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2021, Vol.9, p.105131-105143
issn 2169-3536
2169-3536
language eng
recordid cdi_ieee_primary_9495812
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Algorithms
Blurring
Cameras
Convolutional neural networks
CycleGAN
Feature extraction
Generative adversarial networks
Image acquisition
Image enhancement
Image quality
Image resolution
Image restoration
Kernel
Motion image deblurring
Motion stability
Neural networks
Object motion
Object recognition
pyramid attention mechanism
RMSProp
Symmetry
symmetry generative adversarial network
Training
Vibration
title PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T04%3A17%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=PAMSGAN:%20Pyramid%20Attention%20Mechanism-Oriented%20Symmetry%20Generative%20Adversarial%20Network%20for%20Motion%20Image%20Deblurring&rft.jtitle=IEEE%20access&rft.au=Zhang,%20Zhenfeng&rft.date=2021&rft.volume=9&rft.spage=105131&rft.epage=105143&rft.pages=105131-105143&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2021.3099803&rft_dat=%3Cproquest_ieee_%3E2556486088%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2556486088&rft_id=info:pmid/&rft_ieee_id=9495812&rft_doaj_id=oai_doaj_org_article_2fd23bcc3d7745d882c4649ad76f8d0f&rfr_iscdi=true