BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics
Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this...
Gespeichert in:
Veröffentlicht in: | IEEE transactions on circuits and systems for video technology 2022-10, Vol.32 (10), p.6657-6670 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext bestellen |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 6670 |
---|---|
container_issue | 10 |
container_start_page | 6657 |
container_title | IEEE transactions on circuits and systems for video technology |
container_volume | 32 |
creator | Peng, Fei Yin, Liping Long, Min |
description | Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images. |
doi_str_mv | 10.1109/TCSVT.2022.3177238 |
format | Article |
fullrecord | <record><control><sourceid>proquest_RIE</sourceid><recordid>TN_cdi_ieee_primary_9780115</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9780115</ieee_id><sourcerecordid>2721428359</sourcerecordid><originalsourceid>FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</originalsourceid><addsrcrecordid>eNo9kMFOwzAQRCMEEqXwA3CJxDnFXse1w60NtFSqyoHC1XKcDXLVJsV2QPw9LkWcZnc0s9K-JLmmZEQpKe7W5cvbegQEYMSoEMDkSTKgnMsMgPDTOBNOMwmUnycX3m8IobnMxSCx04cym09W9-nU1tahCbZr9TYtu_YTnY9LOsXwhdhGa7fvA7psji06HbBOdVunKx16FxszbWyUxU6_o0-bzqWTNths1jlsvTX-Mjlr9Nbj1Z8Ok9fZ47p8ypbP80U5WWYGgIeMCanJuBK5KSQrqKiZkQXkUuaaaFY0xvDo6YrUuWlqDnJcUahQjllVVXkNbJjcHu_uXffRow9q0_Uu_uQVCKA5SMaLmIJjyrjOe4eN2ju70-5bUaIOSNUvUnVAqv6QxtLNsWQR8b9QCEko5ewHRF1yLg</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2721428359</pqid></control><display><type>article</type><title>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</title><source>IEEE Electronic Library (IEL)</source><creator>Peng, Fei ; Yin, Liping ; Long, Min</creator><creatorcontrib>Peng, Fei ; Yin, Liping ; Long, Min</creatorcontrib><description>Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.</description><identifier>ISSN: 1051-8215</identifier><identifier>EISSN: 1558-2205</identifier><identifier>DOI: 10.1109/TCSVT.2022.3177238</identifier><identifier>CODEN: ITCTEM</identifier><language>eng</language><publisher>New York: IEEE</publisher><subject>computer-generated facial image ; Conversion ; Convolution ; Convolutional neural networks ; Digital image forensics ; Discriminators ; Domains ; Feature extraction ; Forensic sciences ; Forensics ; generative adversarial network ; Generative adversarial networks ; High pass filters ; Image coding ; Image color analysis ; natural facial image</subject><ispartof>IEEE transactions on circuits and systems for video technology, 2022-10, Vol.32 (10), p.6657-6670</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2022</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</citedby><cites>FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</cites><orcidid>0000-0002-1229-2317 ; 0000-0001-8053-4587</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9780115$$EHTML$$P50$$Gieee$$H</linktohtml><link.rule.ids>314,776,780,792,27901,27902,54733</link.rule.ids><linktorsrc>$$Uhttps://ieeexplore.ieee.org/document/9780115$$EView_record_in_IEEE$$FView_record_in_$$GIEEE</linktorsrc></links><search><creatorcontrib>Peng, Fei</creatorcontrib><creatorcontrib>Yin, Liping</creatorcontrib><creatorcontrib>Long, Min</creatorcontrib><title>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</title><title>IEEE transactions on circuits and systems for video technology</title><addtitle>TCSVT</addtitle><description>Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.</description><subject>computer-generated facial image</subject><subject>Conversion</subject><subject>Convolution</subject><subject>Convolutional neural networks</subject><subject>Digital image forensics</subject><subject>Discriminators</subject><subject>Domains</subject><subject>Feature extraction</subject><subject>Forensic sciences</subject><subject>Forensics</subject><subject>generative adversarial network</subject><subject>Generative adversarial networks</subject><subject>High pass filters</subject><subject>Image coding</subject><subject>Image color analysis</subject><subject>natural facial image</subject><issn>1051-8215</issn><issn>1558-2205</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>RIE</sourceid><recordid>eNo9kMFOwzAQRCMEEqXwA3CJxDnFXse1w60NtFSqyoHC1XKcDXLVJsV2QPw9LkWcZnc0s9K-JLmmZEQpKe7W5cvbegQEYMSoEMDkSTKgnMsMgPDTOBNOMwmUnycX3m8IobnMxSCx04cym09W9-nU1tahCbZr9TYtu_YTnY9LOsXwhdhGa7fvA7psji06HbBOdVunKx16FxszbWyUxU6_o0-bzqWTNths1jlsvTX-Mjlr9Nbj1Z8Ok9fZ47p8ypbP80U5WWYGgIeMCanJuBK5KSQrqKiZkQXkUuaaaFY0xvDo6YrUuWlqDnJcUahQjllVVXkNbJjcHu_uXffRow9q0_Uu_uQVCKA5SMaLmIJjyrjOe4eN2ju70-5bUaIOSNUvUnVAqv6QxtLNsWQR8b9QCEko5ewHRF1yLg</recordid><startdate>20221001</startdate><enddate>20221001</enddate><creator>Peng, Fei</creator><creator>Yin, Liping</creator><creator>Long, Min</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0002-1229-2317</orcidid><orcidid>https://orcid.org/0000-0001-8053-4587</orcidid></search><sort><creationdate>20221001</creationdate><title>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</title><author>Peng, Fei ; Yin, Liping ; Long, Min</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c225t-378a06b74c983917d3c8924884a0a39fcc57d3ab0d4cfd5286b12be863bbb4d23</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>computer-generated facial image</topic><topic>Conversion</topic><topic>Convolution</topic><topic>Convolutional neural networks</topic><topic>Digital image forensics</topic><topic>Discriminators</topic><topic>Domains</topic><topic>Feature extraction</topic><topic>Forensic sciences</topic><topic>Forensics</topic><topic>generative adversarial network</topic><topic>Generative adversarial networks</topic><topic>High pass filters</topic><topic>Image coding</topic><topic>Image color analysis</topic><topic>natural facial image</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Peng, Fei</creatorcontrib><creatorcontrib>Yin, Liping</creatorcontrib><creatorcontrib>Long, Min</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics & Communications Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>IEEE transactions on circuits and systems for video technology</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>Peng, Fei</au><au>Yin, Liping</au><au>Long, Min</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics</atitle><jtitle>IEEE transactions on circuits and systems for video technology</jtitle><stitle>TCSVT</stitle><date>2022-10-01</date><risdate>2022</risdate><volume>32</volume><issue>10</issue><spage>6657</spage><epage>6670</epage><pages>6657-6670</pages><issn>1051-8215</issn><eissn>1558-2205</eissn><coden>ITCTEM</coden><abstract>Aiming at degrading the capability of the existing forensic methods in discriminating computer generated and natural facial images, a bidirectional conversion between computer-generated and natural facial images based on generative adversarial network (BDC-GAN) is proposed for anti-forensics in this paper. The generator of BDC-GAN is composed of noise encoding and content encoding. In the noise encoding, three high-pass filters are first utilized to extract the sensor pattern noise of the image, and then the stacked convolution layer is combined to continue encoding. In the content encoding, VGG-19 is truncated and fine-tuned to encode the content of the image. Some stacked convolution layers and adaptive instance normalization layer are used in the decoder. The discriminator uses multi-scale image discriminator. Furthermore, content loss and noise loss are well designed, and hyperparameters are reasonably set to accomplish the bidirectional conversion between two domain images meanwhile retaining the original facial contour. Experimental results and analysis demonstrate that the proposed anti-forensic method can achieve better visual quality and stronger deception ability compared with the existing unidirectional CG facial image anti-forensic methods and bidirectional domain adaptive methods, and its effectiveness is verified by the tests on the existing 9 forensic methods. It reveals that the existing forensic techniques can be bypassed by using adversarial learning, and it will eventually push the performance improvement of the discrimination of computer generated and natural facial images.</abstract><cop>New York</cop><pub>IEEE</pub><doi>10.1109/TCSVT.2022.3177238</doi><tpages>14</tpages><orcidid>https://orcid.org/0000-0002-1229-2317</orcidid><orcidid>https://orcid.org/0000-0001-8053-4587</orcidid></addata></record> |
fulltext | fulltext_linktorsrc |
identifier | ISSN: 1051-8215 |
ispartof | IEEE transactions on circuits and systems for video technology, 2022-10, Vol.32 (10), p.6657-6670 |
issn | 1051-8215 1558-2205 |
language | eng |
recordid | cdi_ieee_primary_9780115 |
source | IEEE Electronic Library (IEL) |
subjects | computer-generated facial image Conversion Convolution Convolutional neural networks Digital image forensics Discriminators Domains Feature extraction Forensic sciences Forensics generative adversarial network Generative adversarial networks High pass filters Image coding Image color analysis natural facial image |
title | BDC-GAN: Bidirectional Conversion Between Computer-Generated and Natural Facial Images for Anti-Forensics |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-14T04%3A24%3A10IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_RIE&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=BDC-GAN:%20Bidirectional%20Conversion%20Between%20Computer-Generated%20and%20Natural%20Facial%20Images%20for%20Anti-Forensics&rft.jtitle=IEEE%20transactions%20on%20circuits%20and%20systems%20for%20video%20technology&rft.au=Peng,%20Fei&rft.date=2022-10-01&rft.volume=32&rft.issue=10&rft.spage=6657&rft.epage=6670&rft.pages=6657-6670&rft.issn=1051-8215&rft.eissn=1558-2205&rft.coden=ITCTEM&rft_id=info:doi/10.1109/TCSVT.2022.3177238&rft_dat=%3Cproquest_RIE%3E2721428359%3C/proquest_RIE%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2721428359&rft_id=info:pmid/&rft_ieee_id=9780115&rfr_iscdi=true |