An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning

Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and f...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:The Visual computer 2022-02, Vol.38 (2), p.509-523
Hauptverfasser: Khan, Muhammad Junaid, Khan, Muhammad Jaleed, Siddiqui, Adil Masood, Khurshid, Khurram
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 523
container_issue 2
container_start_page 509
container_title The Visual computer
container_volume 38
creator Khan, Muhammad Junaid
Khan, Muhammad Jaleed
Siddiqui, Adil Masood
Khurshid, Khurram
description Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.
doi_str_mv 10.1007/s00371-020-02031-z
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2917978420</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2917978420</sourcerecordid><originalsourceid>FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</originalsourceid><addsrcrecordid>eNp9kcFqHDEMhk1podtNX6AnQ8-T2mPPeHwMoUkKgVz2brS2PHXYtbe2J9A8Sx42nmygtx6EEPyffqSfkG-cXXLG1I_CmFC8Yz1bS_Du-QPZcCn6rhd8-Eg2jKup69WkP5MvpTyyNiupN-TlKlJYajpCRUchOoreBxswVmpTfEqHpYYU4UAh29-hoq1LRupTpi6UeQkFuxCfIAdohAeLNKNNcwwrRpcS4kxjWmV7KM3CQYXmOB-bA7xpVlOHeKI1QyweMz0g5NjAC_LJw6Hg1_e-Jbubn7vru-7-4fbX9dV9ZwXXteO9c4NCPw7Y-0FoyZWHveNMOm6lHqdBjp7L_aQdB8_0qKQQTACOe5RciC35fl57yunPgqWax7TkdnMxveZKq0m2n25Jf1bZnErJ6M0phyPkv4Yzs4ZgziGYFoB5C8E8N0icodLEccb8b_V_qFfcBI6E</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2917978420</pqid></control><display><type>article</type><title>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</title><source>SpringerLink Journals</source><source>ProQuest Central</source><creator>Khan, Muhammad Junaid ; Khan, Muhammad Jaleed ; Siddiqui, Adil Masood ; Khurshid, Khurram</creator><creatorcontrib>Khan, Muhammad Junaid ; Khan, Muhammad Jaleed ; Siddiqui, Adil Masood ; Khurshid, Khurram</creatorcontrib><description>Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.</description><identifier>ISSN: 0178-2789</identifier><identifier>EISSN: 1432-2315</identifier><identifier>DOI: 10.1007/s00371-020-02031-z</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Access control ; Accuracy ; Artificial Intelligence ; Artificial neural networks ; Automation ; Classification ; Computer Graphics ; Computer Science ; Cosmetics ; Data augmentation ; Deep learning ; Face recognition ; Facial recognition technology ; Image Processing and Computer Vision ; Image quality ; Invariants ; Machine learning ; Neural networks ; Original Article ; Performance evaluation ; Sandler, Adam ; Surveillance</subject><ispartof>The Visual computer, 2022-02, Vol.38 (2), p.509-523</ispartof><rights>Springer-Verlag GmbH Germany, part of Springer Nature 2021</rights><rights>Springer-Verlag GmbH Germany, part of Springer Nature 2021.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</citedby><cites>FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</cites><orcidid>0000-0002-5912-0504</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s00371-020-02031-z$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://www.proquest.com/docview/2917978420?pq-origsite=primo$$EHTML$$P50$$Gproquest$$H</linktohtml><link.rule.ids>314,776,780,21367,27901,27902,33721,41464,42533,43781,51294</link.rule.ids></links><search><creatorcontrib>Khan, Muhammad Junaid</creatorcontrib><creatorcontrib>Khan, Muhammad Jaleed</creatorcontrib><creatorcontrib>Siddiqui, Adil Masood</creatorcontrib><creatorcontrib>Khurshid, Khurram</creatorcontrib><title>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</title><title>The Visual computer</title><addtitle>Vis Comput</addtitle><description>Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.</description><subject>Access control</subject><subject>Accuracy</subject><subject>Artificial Intelligence</subject><subject>Artificial neural networks</subject><subject>Automation</subject><subject>Classification</subject><subject>Computer Graphics</subject><subject>Computer Science</subject><subject>Cosmetics</subject><subject>Data augmentation</subject><subject>Deep learning</subject><subject>Face recognition</subject><subject>Facial recognition technology</subject><subject>Image Processing and Computer Vision</subject><subject>Image quality</subject><subject>Invariants</subject><subject>Machine learning</subject><subject>Neural networks</subject><subject>Original Article</subject><subject>Performance evaluation</subject><subject>Sandler, Adam</subject><subject>Surveillance</subject><issn>0178-2789</issn><issn>1432-2315</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2022</creationdate><recordtype>article</recordtype><sourceid>BENPR</sourceid><recordid>eNp9kcFqHDEMhk1podtNX6AnQ8-T2mPPeHwMoUkKgVz2brS2PHXYtbe2J9A8Sx42nmygtx6EEPyffqSfkG-cXXLG1I_CmFC8Yz1bS_Du-QPZcCn6rhd8-Eg2jKup69WkP5MvpTyyNiupN-TlKlJYajpCRUchOoreBxswVmpTfEqHpYYU4UAh29-hoq1LRupTpi6UeQkFuxCfIAdohAeLNKNNcwwrRpcS4kxjWmV7KM3CQYXmOB-bA7xpVlOHeKI1QyweMz0g5NjAC_LJw6Hg1_e-Jbubn7vru-7-4fbX9dV9ZwXXteO9c4NCPw7Y-0FoyZWHveNMOm6lHqdBjp7L_aQdB8_0qKQQTACOe5RciC35fl57yunPgqWax7TkdnMxveZKq0m2n25Jf1bZnErJ6M0phyPkv4Yzs4ZgziGYFoB5C8E8N0icodLEccb8b_V_qFfcBI6E</recordid><startdate>20220201</startdate><enddate>20220201</enddate><creator>Khan, Muhammad Junaid</creator><creator>Khan, Muhammad Jaleed</creator><creator>Siddiqui, Adil Masood</creator><creator>Khurshid, Khurram</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>8FE</scope><scope>8FG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>GNUQQ</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K7-</scope><scope>P5Z</scope><scope>P62</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><orcidid>https://orcid.org/0000-0002-5912-0504</orcidid></search><sort><creationdate>20220201</creationdate><title>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</title><author>Khan, Muhammad Junaid ; Khan, Muhammad Jaleed ; Siddiqui, Adil Masood ; Khurshid, Khurram</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c319t-12dd57ef65e2f539417fabd104d1c4968546f14b89d1af096743303ae6be4133</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2022</creationdate><topic>Access control</topic><topic>Accuracy</topic><topic>Artificial Intelligence</topic><topic>Artificial neural networks</topic><topic>Automation</topic><topic>Classification</topic><topic>Computer Graphics</topic><topic>Computer Science</topic><topic>Cosmetics</topic><topic>Data augmentation</topic><topic>Deep learning</topic><topic>Face recognition</topic><topic>Facial recognition technology</topic><topic>Image Processing and Computer Vision</topic><topic>Image quality</topic><topic>Invariants</topic><topic>Machine learning</topic><topic>Neural networks</topic><topic>Original Article</topic><topic>Performance evaluation</topic><topic>Sandler, Adam</topic><topic>Surveillance</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Khan, Muhammad Junaid</creatorcontrib><creatorcontrib>Khan, Muhammad Jaleed</creatorcontrib><creatorcontrib>Siddiqui, Adil Masood</creatorcontrib><creatorcontrib>Khurshid, Khurram</creatorcontrib><collection>CrossRef</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>ProQuest Central Student</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>Computer Science Database</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><jtitle>The Visual computer</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Khan, Muhammad Junaid</au><au>Khan, Muhammad Jaleed</au><au>Siddiqui, Adil Masood</au><au>Khurshid, Khurram</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning</atitle><jtitle>The Visual computer</jtitle><stitle>Vis Comput</stitle><date>2022-02-01</date><risdate>2022</risdate><volume>38</volume><issue>2</issue><spage>509</spage><epage>523</epage><pages>509-523</pages><issn>0178-2789</issn><eissn>1432-2315</eissn><abstract>Face recognition is diversely used in modern biometric and security applications. Most of the current face recognition techniques show good results in a constrained environment. However, these techniques face many problems in real-world scenarios such as low-quality images, temporal variations and facial disguises creating variations in facial features. The reason for these deteriorating results is the employment of handcrafted features having weak generalization capabilities and neglecting the complexities associated with domain adaption in case of deep learning models. In this paper, we have studied the efficacy of deep learning methods incorporating simple noise-based data augmentation for disguise invariant face recognition (DIFR). The proposed method detects face in an image using Viola Jones face detector and classifies it using a pre-trained Convolutional Neural Network (CNN) fine-tuned for DIFR. During transfer learning, a pre-trained CNN learns generalized disguise-invariant features from facial images of several subjects to correctly identify them under varying facial disguises. We have compared four different pre-trained 2D CNNs, each with different number of learning parameters, based on their classification accuracy and execution time for selecting a suitable model for DIFR. Comprehensive experiments and comparative analysis have been conducted on six challenging facial disguise datasets. Resnet-18 gives the best trade-off between accuracy and efficiency, by achieving an average accuracy of 98.19% with an average execution time of 0.32 seconds. The promising results achieved in these experiments reflect the efficiency of the proposed method and outperforms the existing methods in all aspects.</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s00371-020-02031-z</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0002-5912-0504</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 0178-2789
ispartof The Visual computer, 2022-02, Vol.38 (2), p.509-523
issn 0178-2789
1432-2315
language eng
recordid cdi_proquest_journals_2917978420
source SpringerLink Journals; ProQuest Central
subjects Access control
Accuracy
Artificial Intelligence
Artificial neural networks
Automation
Classification
Computer Graphics
Computer Science
Cosmetics
Data augmentation
Deep learning
Face recognition
Facial recognition technology
Image Processing and Computer Vision
Image quality
Invariants
Machine learning
Neural networks
Original Article
Performance evaluation
Sandler, Adam
Surveillance
title An automated and efficient convolutional architecture for disguise-invariant face recognition using noise-based data augmentation and deep transfer learning
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-05T06%3A58%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=An%20automated%20and%20efficient%20convolutional%20architecture%20for%20disguise-invariant%20face%20recognition%20using%20noise-based%20data%20augmentation%20and%20deep%20transfer%20learning&rft.jtitle=The%20Visual%20computer&rft.au=Khan,%20Muhammad%20Junaid&rft.date=2022-02-01&rft.volume=38&rft.issue=2&rft.spage=509&rft.epage=523&rft.pages=509-523&rft.issn=0178-2789&rft.eissn=1432-2315&rft_id=info:doi/10.1007/s00371-020-02031-z&rft_dat=%3Cproquest_cross%3E2917978420%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2917978420&rft_id=info:pmid/&rfr_iscdi=true