An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning
Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and f...
Gespeichert in:
Veröffentlicht in: | The Visual computer 2022-02, Vol.38 (2), p.509-523 |
---|---|
Hauptverfasser: | , , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 523 |
---|---|
container_issue | 2 |
container_start_page | 509 |
container_title | The Visual computer |
container_volume | 38 |
creator | Khan, Muhammad Junaid Khan, Muhammad Jaleed Siddiqui, Adil Masood Khurshid, Khurram |
description | Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects. |
doi_str_mv | 10.1007/s00371-020-02031-z |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2917978420</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2917978420</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</originalsourceid><addsrcrecordid>eNp9kcFqHDEMhk1podtNX6AnQ8-T2mPPeHwMoUkKgVz2brS2PHXYtbe2J9A8Sx42nmygtx6EEPyffqSfkG-cXXLG1I_CmFC8Yz1bS_Du-QPZcCn6rhd8-Eg2jKup69WkP5MvpTyyNiupN-TlKlJYajpCRUchOoreBxswVmpTfEqHpYYU4UAh29-hoq1LRupTpi6UeQkFuxCfIAdohAeLNKNNcwwrRpcS4kxjWmV7KM3CQYXmOB-bA7xpVlOHeKI1QyweMz0g5NjAC_LJw6Hg1_e-Jbubn7vru-7-4fbX9dV9ZwXXteO9c4NCPw7Y-0FoyZWHveNMOm6lHqdBjp7L_aQdB8_0qKQQTACOe5RciC35fl57yunPgqWax7TkdnMxveZKq0m2n25Jf1bZnErJ6M0phyPkv4Yzs4ZgziGYFoB5C8E8N0icodLEccb8b_V_qFfcBI6E</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2917978420</pqid></control><display><type>article</type><title>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</title><source>SpringerLink Journals</source><source>ProQuest Central</source><creator>Khan, Muhammad Junaid ; Khan, Muhammad Jaleed ; Siddiqui, Adil Masood ; Khurshid, Khurram</creator><creatorcontrib>Khan, Muhammad Junaid ; Khan, Muhammad Jaleed ; Siddiqui, Adil Masood ; Khurshid, Khurram</creatorcontrib><description>Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.</description><identifier>ISSN: 0178-2789</identifier><identifier>EISSN: 1432-2315</identifier><identifier>DOI: 10.1007/s00371-020-02031-z</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Access control ; Accuracy ; Artificial Intelligence ; Artificial neural networks ; Automation ; Classification ; Computer Graphics ; Computer Science ; Cosmetics ; Data augmentation ; Deep learning ; Face recognition ; Facial recognition technology ; Image Processing and Computer Vision ; Image quality ; Invariants ; Machine learning ; Neural networks ; Original Article ; Performance evaluation ; Sandler, Adam ; Surveillance</subject><ispartof>The Visual computer, 2022-02, Vol.38 (2), p.509-523</ispartof><rights>Springer-Verlag GmbH Germany, part of Springer Nature 2021</rights><rights>Springer-Verlag GmbH Germany, part of Springer Nature 2021.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</citedby><cites>FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</cites><orcidid>0000-0002-5912-0504</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00371-020-02031-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2917978420?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,776,780,21367,27901,27902,33721,41464,42533,43781,51294</link.rule.ids></links><search><creatorcontrib>Khan, Muhammad Junaid</creatorcontrib><creatorcontrib>Khan, Muhammad Jaleed</creatorcontrib><creatorcontrib>Siddiqui, Adil Masood</creatorcontrib><creatorcontrib>Khurshid, Khurram</creatorcontrib><title>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</title><title>The Visual computer</title><addtitle>Vis Comput</addtitle><description>Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.</description><subject>Access control</subject><subject>Accuracy</subject><subject>Artificial Intelligence</subject><subject>Artificial neural networks</subject><subject>Automation</subject><subject>Classification</subject><subject>Computer Graphics</subject><subject>Computer Science</subject><subject>Cosmetics</subject><subject>Data augmentation</subject><subject>Deep learning</subject><subject>Face recognition</subject><subject>Facial recognition technology</subject><subject>Image Processing and Computer Vision</subject><subject>Image quality</subject><subject>Invariants</subject><subject>Machine learning</subject><subject>Neural networks</subject><subject>Original Article</subject><subject>Performance evaluation</subject><subject>Sandler, Adam</subject><subject>Surveillance</subject><issn>0178-2789</issn><issn>1432-2315</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNp9kcFqHDEMhk1podtNX6AnQ8-T2mPPeHwMoUkKgVz2brS2PHXYtbe2J9A8Sx42nmygtx6EEPyffqSfkG-cXXLG1I_CmFC8Yz1bS_Du-QPZcCn6rhd8-Eg2jKup69WkP5MvpTyyNiupN-TlKlJYajpCRUchOoreBxswVmpTfEqHpYYU4UAh29-hoq1LRupTpi6UeQkFuxCfIAdohAeLNKNNcwwrRpcS4kxjWmV7KM3CQYXmOB-bA7xpVlOHeKI1QyweMz0g5NjAC_LJw6Hg1_e-Jbubn7vru-7-4fbX9dV9ZwXXteO9c4NCPw7Y-0FoyZWHveNMOm6lHqdBjp7L_aQdB8_0qKQQTACOe5RciC35fl57yunPgqWax7TkdnMxveZKq0m2n25Jf1bZnErJ6M0phyPkv4Yzs4ZgziGYFoB5C8E8N0icodLEccb8b_V_qFfcBI6E</recordid><startdate>20220201</startdate><enddate>20220201</enddate><creator>Khan, Muhammad Junaid</creator><creator>Khan, Muhammad Jaleed</creator><creator>Siddiqui, Adil Masood</creator><creator>Khurshid, Khurram</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><orcidid>https://orcid.org/0000-0002-5912-0504</orcidid></search><sort><creationdate>20220201</creationdate><title>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</title><author>Khan, Muhammad Junaid ; Khan, Muhammad Jaleed ; Siddiqui, Adil Masood ; Khurshid, Khurram</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Access control</topic><topic>Accuracy</topic><topic>Artificial Intelligence</topic><topic>Artificial neural networks</topic><topic>Automation</topic><topic>Classification</topic><topic>Computer Graphics</topic><topic>Computer Science</topic><topic>Cosmetics</topic><topic>Data augmentation</topic><topic>Deep learning</topic><topic>Face recognition</topic><topic>Facial recognition technology</topic><topic>Image Processing and Computer Vision</topic><topic>Image quality</topic><topic>Invariants</topic><topic>Machine learning</topic><topic>Neural networks</topic><topic>Original Article</topic><topic>Performance evaluation</topic><topic>Sandler, Adam</topic><topic>Surveillance</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Khan, Muhammad Junaid</creatorcontrib><creatorcontrib>Khan, Muhammad Jaleed</creatorcontrib><creatorcontrib>Siddiqui, Adil Masood</creatorcontrib><creatorcontrib>Khurshid, Khurram</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><jtitle>The Visual computer</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Khan, Muhammad Junaid</au><au>Khan, Muhammad Jaleed</au><au>Siddiqui, Adil Masood</au><au>Khurshid, Khurram</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</atitle><jtitle>The Visual computer</jtitle><stitle>Vis Comput</stitle><date>2022-02-01</date><risdate>2022</risdate><volume>38</volume><issue>2</issue><spage>509</spage><epage>523</epage><pages>509-523</pages><issn>0178-2789</issn><eissn>1432-2315</eissn><abstract>Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s00371-020-02031-z</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-5912-0504</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 0178-2789 |
ispartof | The Visual computer, 2022-02, Vol.38 (2), p.509-523 |
issn | 0178-2789 1432-2315 |
language | eng |
recordid | cdi_proquest_journals_2917978420 |
source | SpringerLink Journals; ProQuest Central |
subjects | Access control Accuracy Artificial Intelligence Artificial neural networks Automation Classification Computer Graphics Computer Science Cosmetics Data augmentation Deep learning Face recognition Facial recognition technology Image Processing and Computer Vision Image quality Invariants Machine learning Neural networks Original Article Performance evaluation Sandler, Adam Surveillance |
title | An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T06%3A58%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20automated%20and%20efficient%20convolutional%20architecture%20for%20disguise-invariant%20face%20recognition%20using%20noise-based%20data%20augmentation%20and%20deep%20transfer%20learning&rft.jtitle=The%20Visual%20computer&rft.au=Khan,%20Muhammad%20Junaid&rft.date=2022-02-01&rft.volume=38&rft.issue=2&rft.spage=509&rft.epage=523&rft.pages=509-523&rft.issn=0178-2789&rft.eissn=1432-2315&rft_id=info:doi/10.1007/s00371-020-02031-z&rft_dat=%3Cproquest_cross%3E2917978420%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2917978420&rft_id=info:pmid/&rfr_iscdi=true |