Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery

Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Multimedia tools and applications 2024-03, Vol.83 (8), p.24653-24678
Hauptverfasser: Yawale, Nupoor, Sahu, Neeraj, Khalsa, Nikkoo
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 24678
container_issue 8
container_start_page 24653
container_title Multimedia tools and applications
container_volume 83
creator Yawale, Nupoor
Sahu, Neeraj
Khalsa, Nikkoo
description Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural & synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier & Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural & synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.
doi_str_mv 10.1007/s11042-023-16296-8
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2930092398</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2930092398</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-486954caa64debc4437e24307a6e01668ad39aa51fc6df803ceb875e36bb12a03</originalsourceid><addsrcrecordid>eNp9kDtPwzAUhSMEEuXxB5gsIbEZ_EicZETlKVVigdm6cW5aV6lTfJMhGz-dtEWCicl3ON-Rz5ckV1LcSiHyO5JSpIoLpbk0qjS8OEpmMss1z3Mlj__cp8kZ0VoIaTKVzpKvByS_DKxrGLCVX654jYF8P7LKd9wH2vqINWsQ-iEigwDtSJ5YjbhlLUIMPizZpquxZU0XGQ0Vdy0Q-cY76H23rw47Glp2w2gM_Qp775jfwBLjeJGcNNASXv6858nH0-P7_IUv3p5f5_cL7lQuep4WpsxSB2DSGiuXpjpHlWqRg8Fpiymg1iVAJhtn6qYQ2mFV5BlqU1VSgdDnyfWhdxu7zwGpt-tuiNMcsqrUQpRKl8WUUoeUix1RxMZu4_TROFop7M60PZi2k2m7N213kD5ANIXDNOq3-h_qGyAjgvs</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2930092398</pqid></control><display><type>article</type><title>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic imagery</title><source>Springer Nature - Complete Springer Journals</source><creator>Yawale, Nupoor ; Sahu, Neeraj ; Khalsa, Nikkoo</creator><creatorcontrib>Yawale, Nupoor ; Sahu, Neeraj ; Khalsa, Nikkoo</creatorcontrib><description>Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier &amp; Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural &amp; synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.</description><identifier>ISSN: 1573-7721</identifier><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-023-16296-8</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Accuracy ; Biomimetics ; Classification ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Deep learning ; Digital imaging ; Graphical user interface ; High density ; Image processing ; Machine learning ; Multimedia Information Systems ; Special Purpose and Application-Based Systems ; Track 6: Computer Vision for Multimedia Applications</subject><ispartof>Multimedia tools and applications, 2024-03, Vol.83 (8), p.24653-24678</ispartof><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-486954caa64debc4437e24307a6e01668ad39aa51fc6df803ceb875e36bb12a03</cites><orcidid>0000-0001-7231-1340</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-023-16296-8$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-023-16296-8$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Yawale, Nupoor</creatorcontrib><creatorcontrib>Sahu, Neeraj</creatorcontrib><creatorcontrib>Khalsa, Nikkoo</creatorcontrib><title>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic imagery</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier &amp; Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural &amp; synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.</description><subject>Accuracy</subject><subject>Biomimetics</subject><subject>Classification</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Deep learning</subject><subject>Digital imaging</subject><subject>Graphical user interface</subject><subject>High density</subject><subject>Image processing</subject><subject>Machine learning</subject><subject>Multimedia Information Systems</subject><subject>Special Purpose and Application-Based Systems</subject><subject>Track 6: Computer Vision for Multimedia Applications</subject><issn>1573-7721</issn><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kDtPwzAUhSMEEuXxB5gsIbEZ_EicZETlKVVigdm6cW5aV6lTfJMhGz-dtEWCicl3ON-Rz5ckV1LcSiHyO5JSpIoLpbk0qjS8OEpmMss1z3Mlj__cp8kZ0VoIaTKVzpKvByS_DKxrGLCVX654jYF8P7LKd9wH2vqINWsQ-iEigwDtSJ5YjbhlLUIMPizZpquxZU0XGQ0Vdy0Q-cY76H23rw47Glp2w2gM_Qp775jfwBLjeJGcNNASXv6858nH0-P7_IUv3p5f5_cL7lQuep4WpsxSB2DSGiuXpjpHlWqRg8Fpiymg1iVAJhtn6qYQ2mFV5BlqU1VSgdDnyfWhdxu7zwGpt-tuiNMcsqrUQpRKl8WUUoeUix1RxMZu4_TROFop7M60PZi2k2m7N213kD5ANIXDNOq3-h_qGyAjgvs</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Yawale, Nupoor</creator><creator>Sahu, Neeraj</creator><creator>Khalsa, Nikkoo</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-7231-1340</orcidid></search><sort><creationdate>20240301</creationdate><title>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic imagery</title><author>Yawale, Nupoor ; Sahu, Neeraj ; Khalsa, Nikkoo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-486954caa64debc4437e24307a6e01668ad39aa51fc6df803ceb875e36bb12a03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Biomimetics</topic><topic>Classification</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Deep learning</topic><topic>Digital imaging</topic><topic>Graphical user interface</topic><topic>High density</topic><topic>Image processing</topic><topic>Machine learning</topic><topic>Multimedia Information Systems</topic><topic>Special Purpose and Application-Based Systems</topic><topic>Track 6: Computer Vision for Multimedia Applications</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yawale, Nupoor</creatorcontrib><creatorcontrib>Sahu, Neeraj</creatorcontrib><creatorcontrib>Khalsa, Nikkoo</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yawale, Nupoor</au><au>Sahu, Neeraj</au><au>Khalsa, Nikkoo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic imagery</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2024-03-01</date><risdate>2024</risdate><volume>83</volume><issue>8</issue><spage>24653</spage><epage>24678</epage><pages>24653-24678</pages><issn>1573-7721</issn><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural &amp; synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier &amp; Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural &amp; synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-023-16296-8</doi><tpages>26</tpages><orcidid>https://orcid.org/0000-0001-7231-1340</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1573-7721
ispartof Multimedia tools and applications, 2024-03, Vol.83 (8), p.24653-24678
issn 1573-7721
1380-7501
1573-7721
language eng
recordid cdi_proquest_journals_2930092398
source Springer Nature - Complete Springer Journals
subjects Accuracy
Biomimetics
Classification
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Deep learning
Digital imaging
Graphical user interface
High density
Image processing
Machine learning
Multimedia Information Systems
Special Purpose and Application-Based Systems
Track 6: Computer Vision for Multimedia Applications
title Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T16%3A32%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Design%20of%20a%20high-density%20bio-inspired%20feature%20analysis%20deep%20learning%20model%20for%20sub-classification%20of%20natural%20&%20synthetic%20imagery&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Yawale,%20Nupoor&rft.date=2024-03-01&rft.volume=83&rft.issue=8&rft.spage=24653&rft.epage=24678&rft.pages=24653-24678&rft.issn=1573-7721&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-023-16296-8&rft_dat=%3Cproquest_cross%3E2930092398%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2930092398&rft_id=info:pmid/&rfr_iscdi=true