PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring
Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur ima...
Gespeichert in:
Veröffentlicht in: | IEEE access 2021, Vol.9, p.105131-105143 |
---|---|
1. Verfasser: | |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 105143 |
---|---|
container_issue | |
container_start_page | 105131 |
container_title | IEEE access |
container_volume | 9 |
creator | Zhang, Zhenfeng |
description | Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks. |
doi_str_mv | 10.1109/ACCESS.2021.3099803 |
format | Article |
fullrecord | <record><control><sourceid>proquest_ieee_</sourceid><recordid>TN_cdi_ieee_primary_9495812</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9495812</ieee_id><doaj_id>oai_doaj_org_article_2fd23bcc3d7745d882c4649ad76f8d0f</doaj_id><sourcerecordid>2556486088</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</originalsourceid><addsrcrecordid>eNpNkV9v2yAUxa1plVZ1_QR9QdqzM8wfG_ZmZV0WqWkrZXtGGK4zsti016RTvv1oXVXlBXQ453dBpyiuKrqoKqq_tsvl9Xa7YJRVC061VpR_KM5ZVeuSS15_fHf-VFxO057mpbIkm_Pi8b7dbFft7Tdyf0I7BE_alGBMIY5kA-6PHcM0lHcYsgaebE_DAAlPZAUjoE3hCUjrnwAni8EeyC2kfxH_kj4i2cQXynqwOyDfoTscEcO4-1yc9fYwweXrflH8_nH9a_mzvLlbrZftTekEVan0HLiy1nqhpa5BcNfV2vfedR68l1R0wnWqBu4r1vtsFI0WzOp8IbXkjF8U65nro92bBwyDxZOJNpgXIeLOWEzBHcBkAOOdc9w3jZBeKeZELbT1Td0rT_vM-jKzHjA-HmFKZh-POObnGyZlLVRNlcouPrscxmlC6N-mVtQ8V2XmqsxzVea1qpy6mlMBAN4SOn9bVYz_B9UrkS0</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2556486088</pqid></control><display><type>article</type><title>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Zhang, Zhenfeng</creator><creatorcontrib>Zhang, Zhenfeng</creatorcontrib><description>Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2021.3099803</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Blurring ; Cameras ; Convolutional neural networks ; CycleGAN ; Feature extraction ; Generative adversarial networks ; Image acquisition ; Image enhancement ; Image quality ; Image resolution ; Image restoration ; Kernel ; Motion image deblurring ; Motion stability ; Neural networks ; Object motion ; Object recognition ; pyramid attention mechanism ; RMSProp ; Symmetry ; symmetry generative adversarial network ; Training ; Vibration</subject><ispartof>IEEE access, 2021, Vol.9, p.105131-105143</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2021</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</citedby><cites>FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</cites><orcidid>0000-0001-7621-0360</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9495812$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Zhang, Zhenfeng</creatorcontrib><title>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</title><title>IEEE access</title><addtitle>Access</addtitle><description>Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.</description><subject>Algorithms</subject><subject>Blurring</subject><subject>Cameras</subject><subject>Convolutional neural networks</subject><subject>CycleGAN</subject><subject>Feature extraction</subject><subject>Generative adversarial networks</subject><subject>Image acquisition</subject><subject>Image enhancement</subject><subject>Image quality</subject><subject>Image resolution</subject><subject>Image restoration</subject><subject>Kernel</subject><subject>Motion image deblurring</subject><subject>Motion stability</subject><subject>Neural networks</subject><subject>Object motion</subject><subject>Object recognition</subject><subject>pyramid attention mechanism</subject><subject>RMSProp</subject><subject>Symmetry</subject><subject>symmetry generative adversarial network</subject><subject>Training</subject><subject>Vibration</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2021</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpNkV9v2yAUxa1plVZ1_QR9QdqzM8wfG_ZmZV0WqWkrZXtGGK4zsti016RTvv1oXVXlBXQ453dBpyiuKrqoKqq_tsvl9Xa7YJRVC061VpR_KM5ZVeuSS15_fHf-VFxO057mpbIkm_Pi8b7dbFft7Tdyf0I7BE_alGBMIY5kA-6PHcM0lHcYsgaebE_DAAlPZAUjoE3hCUjrnwAni8EeyC2kfxH_kj4i2cQXynqwOyDfoTscEcO4-1yc9fYwweXrflH8_nH9a_mzvLlbrZftTekEVan0HLiy1nqhpa5BcNfV2vfedR68l1R0wnWqBu4r1vtsFI0WzOp8IbXkjF8U65nro92bBwyDxZOJNpgXIeLOWEzBHcBkAOOdc9w3jZBeKeZELbT1Td0rT_vM-jKzHjA-HmFKZh-POObnGyZlLVRNlcouPrscxmlC6N-mVtQ8V2XmqsxzVea1qpy6mlMBAN4SOn9bVYz_B9UrkS0</recordid><startdate>2021</startdate><enddate>2021</enddate><creator>Zhang, Zhenfeng</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0001-7621-0360</orcidid></search><sort><creationdate>2021</creationdate><title>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</title><author>Zhang, Zhenfeng</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-d3e38aaad49596e43cb69dfdcbdedd504b4cb86e3d12fdaaa47942a904b595323</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2021</creationdate><topic>Algorithms</topic><topic>Blurring</topic><topic>Cameras</topic><topic>Convolutional neural networks</topic><topic>CycleGAN</topic><topic>Feature extraction</topic><topic>Generative adversarial networks</topic><topic>Image acquisition</topic><topic>Image enhancement</topic><topic>Image quality</topic><topic>Image resolution</topic><topic>Image restoration</topic><topic>Kernel</topic><topic>Motion image deblurring</topic><topic>Motion stability</topic><topic>Neural networks</topic><topic>Object motion</topic><topic>Object recognition</topic><topic>pyramid attention mechanism</topic><topic>RMSProp</topic><topic>Symmetry</topic><topic>symmetry generative adversarial network</topic><topic>Training</topic><topic>Vibration</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Zhang, Zhenfeng</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Zhang, Zhenfeng</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2021</date><risdate>2021</risdate><volume>9</volume><spage>105131</spage><epage>105143</epage><pages>105131-105143</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Motion blur is a common problem in optical imaging, which is caused by the relative displacement between the subject and the camera in the exposure process of the camera. This can result in motion blur of the acquired image, reduce the image resolution and affect the imaging quality. Motion blur image restoration technology uses the existing motion blur image to restore the clear image through the modeling of imaging physical process and mathematical solution without re-photographing the target scene. It has an important application value in the civil and military fields. Solving the problem of motion blur caused by camera jitter and object motion during camera imaging is a very challenging problem. When the popular generative adversarial network model is directly applied to the image blur blind removal task, serious pattern collapse phenomenon will occur. In this paper, we propose a novel motion image deblurring model based on pyramid attention mechanism-oriented symmetry generative adversarial network. This new method does not need to predict the fuzzy kernel of the blurred images, and can directly realize the blind removal of image motion blur. Based on the original CycleGan, the network structure and loss function of the symmetry generative adversarial network are improved. The accuracy of blind removal of motion images is improved, and the stability of the network is greatly enhanced in the case of limited samples. The generative network adopts the encoding and decoding structure, and introduces the feature pyramid attention mechanism. The combination of multi-scale pyramid features and attention mechanism can capture more rich advanced features to improve the model performance. In the experiment, the RMSProp algorithm is used to optimize the network training. Finally, a clear image is obtained through network adversarial training between generative and discriminant network. Experimental results on the related image blur benchmark datasets show that the restoration quality of the proposed method is higher in terms of subjective and objective evaluation. Meanwhile, the restoration results can achieve better results in subsequent object detection tasks.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2021.3099803</doi><tpages>13</tpages><orcidid>https://orcid.org/0000-0001-7621-0360</orcidid><oa>free_for_read</oa></addata></record> |
fulltext | fulltext |
identifier | ISSN: 2169-3536 |
ispartof | IEEE access, 2021, Vol.9, p.105131-105143 |
issn | 2169-3536 2169-3536 |
language | eng |
recordid | cdi_ieee_primary_9495812 |
source | IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals |
subjects | Algorithms Blurring Cameras Convolutional neural networks CycleGAN Feature extraction Generative adversarial networks Image acquisition Image enhancement Image quality Image resolution Image restoration Kernel Motion image deblurring Motion stability Neural networks Object motion Object recognition pyramid attention mechanism RMSProp Symmetry symmetry generative adversarial network Training Vibration |
title | PAMSGAN: Pyramid Attention Mechanism-Oriented Symmetry Generative Adversarial Network for Motion Image Deblurring |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-07T04%3A17%3A24IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_ieee_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=PAMSGAN:%20Pyramid%20Attention%20Mechanism-Oriented%20Symmetry%20Generative%20Adversarial%20Network%20for%20Motion%20Image%20Deblurring&rft.jtitle=IEEE%20access&rft.au=Zhang,%20Zhenfeng&rft.date=2021&rft.volume=9&rft.spage=105131&rft.epage=105143&rft.pages=105131-105143&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2021.3099803&rft_dat=%3Cproquest_ieee_%3E2556486088%3C/proquest_ieee_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2556486088&rft_id=info:pmid/&rft_ieee_id=9495812&rft_doaj_id=oai_doaj_org_article_2fd23bcc3d7745d882c4649ad76f8d0f&rfr_iscdi=true |