Masked GANs for Face Completion: A Novel Deep Learning Approach

INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work i...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:EAI endorsed transactions on pervasive health and technology 2024-01, Vol.9
Hauptverfasser: Sharma, Anshuman, Nath, Biswaroop, Kar, Tejaswini, Khasim, D
Format: Artikel
Sprache:eng
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title EAI endorsed transactions on pervasive health and technology
container_volume 9
creator Sharma, Anshuman
Nath, Biswaroop
Kar, Tejaswini
Khasim, D
description INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.
doi_str_mv 10.4108/eetpht.9.4850
format Article
fullrecord <record><control><sourceid>crossref</sourceid><recordid>TN_cdi_crossref_primary_10_4108_eetpht_9_4850</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>10_4108_eetpht_9_4850</sourcerecordid><originalsourceid>FETCH-LOGICAL-c108t-3b54ebb4331fbea8464fcfb3f57a428ac841a80a6517739dc3ab750e4aeb07a3</originalsourceid><addsrcrecordid>eNpNzzFPwzAUBGALgURVOrL7DyTY8XOdsKAo0IIUytI9enafaSFNLDtC4t9DVQamu-l0H2O3UuQgRXlHNIX9lFc5lFpcsFkBUmZGgr7816_ZIqUPIYSsCgEgZuzhFdMn7fi63iTux8hX6Ig34zH0NB3G4Z7XfDN-Uc8fiQJvCeNwGN55HUIc0e1v2JXHPtHiL-dsu3raNs9Z-7Z-aeo2c7_npkxZDWQtKCW9JSxhCd55q7w2CEWJrgSJpcCllsaoaucUWqMFAZIVBtWcZedZF8eUIvkuxMMR43cnRXfyd2d_V3Unv_oBVpBOHQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype></control><display><type>article</type><title>Masked GANs for Face Completion: A Novel Deep Learning Approach</title><source>EZB-FREE-00999 freely available EZB journals</source><creator>Sharma, Anshuman ; Nath, Biswaroop ; Kar, Tejaswini ; Khasim, D</creator><creatorcontrib>Sharma, Anshuman ; Nath, Biswaroop ; Kar, Tejaswini ; Khasim, D</creatorcontrib><description>INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.</description><identifier>ISSN: 2411-7145</identifier><identifier>EISSN: 2411-7145</identifier><identifier>DOI: 10.4108/eetpht.9.4850</identifier><language>eng</language><ispartof>EAI endorsed transactions on pervasive health and technology, 2024-01, Vol.9</ispartof><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c108t-3b54ebb4331fbea8464fcfb3f57a428ac841a80a6517739dc3ab750e4aeb07a3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><link.rule.ids>314,777,781,27905,27906</link.rule.ids></links><search><creatorcontrib>Sharma, Anshuman</creatorcontrib><creatorcontrib>Nath, Biswaroop</creatorcontrib><creatorcontrib>Kar, Tejaswini</creatorcontrib><creatorcontrib>Khasim, D</creatorcontrib><title>Masked GANs for Face Completion: A Novel Deep Learning Approach</title><title>EAI endorsed transactions on pervasive health and technology</title><description>INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.</description><issn>2411-7145</issn><issn>2411-7145</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNpNzzFPwzAUBGALgURVOrL7DyTY8XOdsKAo0IIUytI9enafaSFNLDtC4t9DVQamu-l0H2O3UuQgRXlHNIX9lFc5lFpcsFkBUmZGgr7816_ZIqUPIYSsCgEgZuzhFdMn7fi63iTux8hX6Ig34zH0NB3G4Z7XfDN-Uc8fiQJvCeNwGN55HUIc0e1v2JXHPtHiL-dsu3raNs9Z-7Z-aeo2c7_npkxZDWQtKCW9JSxhCd55q7w2CEWJrgSJpcCllsaoaucUWqMFAZIVBtWcZedZF8eUIvkuxMMR43cnRXfyd2d_V3Unv_oBVpBOHQ</recordid><startdate>20240115</startdate><enddate>20240115</enddate><creator>Sharma, Anshuman</creator><creator>Nath, Biswaroop</creator><creator>Kar, Tejaswini</creator><creator>Khasim, D</creator><scope>AAYXX</scope><scope>CITATION</scope></search><sort><creationdate>20240115</creationdate><title>Masked GANs for Face Completion: A Novel Deep Learning Approach</title><author>Sharma, Anshuman ; Nath, Biswaroop ; Kar, Tejaswini ; Khasim, D</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c108t-3b54ebb4331fbea8464fcfb3f57a428ac841a80a6517739dc3ab750e4aeb07a3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Sharma, Anshuman</creatorcontrib><creatorcontrib>Nath, Biswaroop</creatorcontrib><creatorcontrib>Kar, Tejaswini</creatorcontrib><creatorcontrib>Khasim, D</creatorcontrib><collection>CrossRef</collection><jtitle>EAI endorsed transactions on pervasive health and technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Sharma, Anshuman</au><au>Nath, Biswaroop</au><au>Kar, Tejaswini</au><au>Khasim, D</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Masked GANs for Face Completion: A Novel Deep Learning Approach</atitle><jtitle>EAI endorsed transactions on pervasive health and technology</jtitle><date>2024-01-15</date><risdate>2024</risdate><volume>9</volume><issn>2411-7145</issn><eissn>2411-7145</eissn><abstract>INTRODUCTION: Recent deep learning based image editing methods have achieved promising results for removing object in an image but fail to generate appreciable performance for removing large objects of complex nature, especially mask from facial images. Towards this goal the objective of this work is to remove mask objects in facial images. In this study, authors propose a novel approach for face completion using Generative Adversarial Networks (GANs) that utilize masked data. This technology can help in image restoration and preservation, thus enabling us to cherish those memories that are held dear to our hearts.OBJECTIVES: Train a GAN to learn the mapping from incomplete to complete face images by utilizing a masked input image.METHODS: The discriminator is trained to distinguish between face images and full ground truth images. Our results indicate that our technique generates high-quality, realistic facial images that are visually comparable to the ground truth and that it can generalise to new faces that were not encountered during training.RESULTS: Our findings indicate that GANs with masked inputs are a good approach for generating whole face images from partial or masked data.CONCLUSION: Our experimental findings show that our method produces facial images of great quality and realism that are visually equivalent to the actual thing. Our proposed approach can also be applied to fresh faces that weren’t seen. The performance can still be improved further using larger dataset. Also, further investigation into adversial attacks may help in improving performance. This technology can be further utilized for developing realtime mask removal software as well.</abstract><doi>10.4108/eetpht.9.4850</doi></addata></record>
fulltext fulltext
identifier ISSN: 2411-7145
ispartof EAI endorsed transactions on pervasive health and technology, 2024-01, Vol.9
issn 2411-7145
2411-7145
language eng
recordid cdi_crossref_primary_10_4108_eetpht_9_4850
source EZB-FREE-00999 freely available EZB journals
title Masked GANs for Face Completion: A Novel Deep Learning Approach
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-20T10%3A43%3A14IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-crossref&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Masked%20GANs%20for%20Face%20Completion:%20A%20Novel%20Deep%20Learning%20Approach&rft.jtitle=EAI%20endorsed%20transactions%20on%20pervasive%20health%20and%20technology&rft.au=Sharma,%20Anshuman&rft.date=2024-01-15&rft.volume=9&rft.issn=2411-7145&rft.eissn=2411-7145&rft_id=info:doi/10.4108/eetpht.9.4850&rft_dat=%3Ccrossref%3E10_4108_eetpht_9_4850%3C/crossref%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true