BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics

Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE transactions on circuits and systems for video technology 2022-10, Vol.32 (10), p.6657-6670
Hauptverfasser: Peng, Fei, Yin, Liping, Long, Min
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 6670
container_issue 10
container_start_page 6657
container_title IEEE transactions on circuits and systems for video technology
container_volume 32
creator Peng, Fei
Yin, Liping
Long, Min
description Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.
doi_str_mv 10.1109/TCSVT.2022.3177238
format Article
fullrecord <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9780115</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9780115</ieee_id><sourcerecordid>2721428359</sourcerecordid><originalsourceid>FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</originalsourceid><addsrcrecordid>eNo9kMFOwzAQRCMEEqXwA3CJxDnFXse1w60NtFSqyoHC1XKcDXLVJsV2QPw9LkWcZnc0s9K-JLmmZEQpKe7W5cvbegQEYMSoEMDkSTKgnMsMgPDTOBNOMwmUnycX3m8IobnMxSCx04cym09W9-nU1tahCbZr9TYtu_YTnY9LOsXwhdhGa7fvA7psji06HbBOdVunKx16FxszbWyUxU6_o0-bzqWTNths1jlsvTX-Mjlr9Nbj1Z8Ok9fZ47p8ypbP80U5WWYGgIeMCanJuBK5KSQrqKiZkQXkUuaaaFY0xvDo6YrUuWlqDnJcUahQjllVVXkNbJjcHu_uXffRow9q0_Uu_uQVCKA5SMaLmIJjyrjOe4eN2ju70-5bUaIOSNUvUnVAqv6QxtLNsWQR8b9QCEko5ewHRF1yLg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2721428359</pqid></control><display><type>article</type><title>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</title><source>IEEE Electronic Library (IEL)</source><creator>Peng, Fei ; Yin, Liping ; Long, Min</creator><creatorcontrib>Peng, Fei ; Yin, Liping ; Long, Min</creatorcontrib><description>Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.</description><identifier>ISSN: 1051-8215</identifier><identifier>EISSN: 1558-2205</identifier><identifier>DOI: 10.1109/TCSVT.2022.3177238</identifier><identifier>CODEN: ITCTEM</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>computer-generated facial image ; Conversion ; Convolution ; Convolutional neural networks ; Digital image forensics ; Discriminators ; Domains ; Feature extraction ; Forensic sciences ; Forensics ; generative adversarial network ; Generative adversarial networks ; High pass filters ; Image coding ; Image color analysis ; natural facial image</subject><ispartof>IEEE transactions on circuits and systems for video technology, 2022-10, Vol.32 (10), p.6657-6670</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</citedby><cites>FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</cites><orcidid>0000-0002-1229-2317 ; 0000-0001-8053-4587</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9780115$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9780115$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Peng, Fei</creatorcontrib><creatorcontrib>Yin, Liping</creatorcontrib><creatorcontrib>Long, Min</creatorcontrib><title>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</title><title>IEEE transactions on circuits and systems for video technology</title><addtitle>TCSVT</addtitle><description>Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.</description><subject>computer-generated facial image</subject><subject>Conversion</subject><subject>Convolution</subject><subject>Convolutional neural networks</subject><subject>Digital image forensics</subject><subject>Discriminators</subject><subject>Domains</subject><subject>Feature extraction</subject><subject>Forensic sciences</subject><subject>Forensics</subject><subject>generative adversarial network</subject><subject>Generative adversarial networks</subject><subject>High pass filters</subject><subject>Image coding</subject><subject>Image color analysis</subject><subject>natural facial image</subject><issn>1051-8215</issn><issn>1558-2205</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kMFOwzAQRCMEEqXwA3CJxDnFXse1w60NtFSqyoHC1XKcDXLVJsV2QPw9LkWcZnc0s9K-JLmmZEQpKe7W5cvbegQEYMSoEMDkSTKgnMsMgPDTOBNOMwmUnycX3m8IobnMxSCx04cym09W9-nU1tahCbZr9TYtu_YTnY9LOsXwhdhGa7fvA7psji06HbBOdVunKx16FxszbWyUxU6_o0-bzqWTNths1jlsvTX-Mjlr9Nbj1Z8Ok9fZ47p8ypbP80U5WWYGgIeMCanJuBK5KSQrqKiZkQXkUuaaaFY0xvDo6YrUuWlqDnJcUahQjllVVXkNbJjcHu_uXffRow9q0_Uu_uQVCKA5SMaLmIJjyrjOe4eN2ju70-5bUaIOSNUvUnVAqv6QxtLNsWQR8b9QCEko5ewHRF1yLg</recordid><startdate>20221001</startdate><enddate>20221001</enddate><creator>Peng, Fei</creator><creator>Yin, Liping</creator><creator>Long, Min</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-1229-2317</orcidid><orcidid>https://orcid.org/0000-0001-8053-4587</orcidid></search><sort><creationdate>20221001</creationdate><title>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</title><author>Peng, Fei ; Yin, Liping ; Long, Min</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>computer-generated facial image</topic><topic>Conversion</topic><topic>Convolution</topic><topic>Convolutional neural networks</topic><topic>Digital image forensics</topic><topic>Discriminators</topic><topic>Domains</topic><topic>Feature extraction</topic><topic>Forensic sciences</topic><topic>Forensics</topic><topic>generative adversarial network</topic><topic>Generative adversarial networks</topic><topic>High pass filters</topic><topic>Image coding</topic><topic>Image color analysis</topic><topic>natural facial image</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Peng, Fei</creatorcontrib><creatorcontrib>Yin, Liping</creatorcontrib><creatorcontrib>Long, Min</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on circuits and systems for video technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Peng, Fei</au><au>Yin, Liping</au><au>Long, Min</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</atitle><jtitle>IEEE transactions on circuits and systems for video technology</jtitle><stitle>TCSVT</stitle><date>2022-10-01</date><risdate>2022</risdate><volume>32</volume><issue>10</issue><spage>6657</spage><epage>6670</epage><pages>6657-6670</pages><issn>1051-8215</issn><eissn>1558-2205</eissn><coden>ITCTEM</coden><abstract>Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCSVT.2022.3177238</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0002-1229-2317</orcidid><orcidid>https://orcid.org/0000-0001-8053-4587</orcidid></addata></record>
fulltext fulltext_linktorsrc
identifier ISSN: 1051-8215
ispartof IEEE transactions on circuits and systems for video technology, 2022-10, Vol.32 (10), p.6657-6670
issn 1051-8215
1558-2205
language eng
recordid cdi_ieee_primary_9780115
source IEEE Electronic Library (IEL)
subjects computer-generated facial image
Conversion
Convolution
Convolutional neural networks
Digital image forensics
Discriminators
Domains
Feature extraction
Forensic sciences
Forensics
generative adversarial network
Generative adversarial networks
High pass filters
Image coding
Image color analysis
natural facial image
title BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T04%3A24%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=BDC-GAN:%20Bidirectional%20Conversion%20Between%20Computer-Generated%20and%20Natural%20Facial%20Images%20for%20Anti-Forensics&rft.jtitle=IEEE%20transactions%20on%20circuits%20and%20systems%20for%20video%20technology&rft.au=Peng,%20Fei&rft.date=2022-10-01&rft.volume=32&rft.issue=10&rft.spage=6657&rft.epage=6670&rft.pages=6657-6670&rft.issn=1051-8215&rft.eissn=1558-2205&rft.coden=ITCTEM&rft_id=info:doi/10.1109/TCSVT.2022.3177238&rft_dat=%3Cproquest_RIE%3E2721428359%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2721428359&rft_id=info:pmid/&rft_ieee_id=9780115&rfr_iscdi=true