Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery
Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural...
Gespeichert in:
Veröffentlicht in: | Multimedia tools and applications 2024-03, Vol.83 (8), p.24653-24678 |
---|---|
Hauptverfasser: | , , |
Format: | Artikel |
Sprache: | eng |
Schlagworte: | |
Online-Zugang: | Volltext |
Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
container_end_page | 24678 |
---|---|
container_issue | 8 |
container_start_page | 24653 |
container_title | Multimedia tools and applications |
container_volume | 83 |
creator | Yawale, Nupoor Sahu, Neeraj Khalsa, Nikkoo |
description | Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural & synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier & Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural & synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios. |
doi_str_mv | 10.1007/s11042-023-16296-8 |
format | Article |
fullrecord | <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_2930092398</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>2930092398</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-486954caa64debc4437e24307a6e01668ad39aa51fc6df803ceb875e36bb12a03</originalsourceid><addsrcrecordid>eNp9kDtPwzAUhSMEEuXxB5gsIbEZ_EicZETlKVVigdm6cW5aV6lTfJMhGz-dtEWCicl3ON-Rz5ckV1LcSiHyO5JSpIoLpbk0qjS8OEpmMss1z3Mlj__cp8kZ0VoIaTKVzpKvByS_DKxrGLCVX654jYF8P7LKd9wH2vqINWsQ-iEigwDtSJ5YjbhlLUIMPizZpquxZU0XGQ0Vdy0Q-cY76H23rw47Glp2w2gM_Qp775jfwBLjeJGcNNASXv6858nH0-P7_IUv3p5f5_cL7lQuep4WpsxSB2DSGiuXpjpHlWqRg8Fpiymg1iVAJhtn6qYQ2mFV5BlqU1VSgdDnyfWhdxu7zwGpt-tuiNMcsqrUQpRKl8WUUoeUix1RxMZu4_TROFop7M60PZi2k2m7N213kD5ANIXDNOq3-h_qGyAjgvs</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2930092398</pqid></control><display><type>article</type><title>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery</title><source>Springer Nature - Complete Springer Journals</source><creator>Yawale, Nupoor ; Sahu, Neeraj ; Khalsa, Nikkoo</creator><creatorcontrib>Yawale, Nupoor ; Sahu, Neeraj ; Khalsa, Nikkoo</creatorcontrib><description>Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural & synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier & Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural & synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.</description><identifier>ISSN: 1573-7721</identifier><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-023-16296-8</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Accuracy ; Biomimetics ; Classification ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Deep learning ; Digital imaging ; Graphical user interface ; High density ; Image processing ; Machine learning ; Multimedia Information Systems ; Special Purpose and Application-Based Systems ; Track 6: Computer Vision for Multimedia Applications</subject><ispartof>Multimedia tools and applications, 2024-03, Vol.83 (8), p.24653-24678</ispartof><rights>The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-486954caa64debc4437e24307a6e01668ad39aa51fc6df803ceb875e36bb12a03</cites><orcidid>0000-0001-7231-1340</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-023-16296-8$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-023-16296-8$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,776,780,27901,27902,41464,42533,51294</link.rule.ids></links><search><creatorcontrib>Yawale, Nupoor</creatorcontrib><creatorcontrib>Sahu, Neeraj</creatorcontrib><creatorcontrib>Khalsa, Nikkoo</creatorcontrib><title>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural & synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier & Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural & synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.</description><subject>Accuracy</subject><subject>Biomimetics</subject><subject>Classification</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Deep learning</subject><subject>Digital imaging</subject><subject>Graphical user interface</subject><subject>High density</subject><subject>Image processing</subject><subject>Machine learning</subject><subject>Multimedia Information Systems</subject><subject>Special Purpose and Application-Based Systems</subject><subject>Track 6: Computer Vision for Multimedia Applications</subject><issn>1573-7721</issn><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kDtPwzAUhSMEEuXxB5gsIbEZ_EicZETlKVVigdm6cW5aV6lTfJMhGz-dtEWCicl3ON-Rz5ckV1LcSiHyO5JSpIoLpbk0qjS8OEpmMss1z3Mlj__cp8kZ0VoIaTKVzpKvByS_DKxrGLCVX654jYF8P7LKd9wH2vqINWsQ-iEigwDtSJ5YjbhlLUIMPizZpquxZU0XGQ0Vdy0Q-cY76H23rw47Glp2w2gM_Qp775jfwBLjeJGcNNASXv6858nH0-P7_IUv3p5f5_cL7lQuep4WpsxSB2DSGiuXpjpHlWqRg8Fpiymg1iVAJhtn6qYQ2mFV5BlqU1VSgdDnyfWhdxu7zwGpt-tuiNMcsqrUQpRKl8WUUoeUix1RxMZu4_TROFop7M60PZi2k2m7N213kD5ANIXDNOq3-h_qGyAjgvs</recordid><startdate>20240301</startdate><enddate>20240301</enddate><creator>Yawale, Nupoor</creator><creator>Sahu, Neeraj</creator><creator>Khalsa, Nikkoo</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>8FD</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><orcidid>https://orcid.org/0000-0001-7231-1340</orcidid></search><sort><creationdate>20240301</creationdate><title>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery</title><author>Yawale, Nupoor ; Sahu, Neeraj ; Khalsa, Nikkoo</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-486954caa64debc4437e24307a6e01668ad39aa51fc6df803ceb875e36bb12a03</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Accuracy</topic><topic>Biomimetics</topic><topic>Classification</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Deep learning</topic><topic>Digital imaging</topic><topic>Graphical user interface</topic><topic>High density</topic><topic>Image processing</topic><topic>Machine learning</topic><topic>Multimedia Information Systems</topic><topic>Special Purpose and Application-Based Systems</topic><topic>Track 6: Computer Vision for Multimedia Applications</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Yawale, Nupoor</creatorcontrib><creatorcontrib>Sahu, Neeraj</creatorcontrib><creatorcontrib>Khalsa, Nikkoo</creatorcontrib><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Technology Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Yawale, Nupoor</au><au>Sahu, Neeraj</au><au>Khalsa, Nikkoo</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2024-03-01</date><risdate>2024</risdate><volume>83</volume><issue>8</issue><spage>24653</spage><epage>24678</epage><pages>24653-24678</pages><issn>1573-7721</issn><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>Differentiation between Natural and Synthetic imagery is a specialized area of digital image processing that assists in identification of computer-generated entities. But due to advancements in computer graphic interfaces, it is difficult to identify synthetically generated images from their natural counterparts. A large number of deep learning models are proposed by researchers, that perform complex feature analysis in order to differentiate between these image sets. But these models are either highly complex, or do not process sub-components of the image, which results in reduced efficiency under large-scale scenarios. Moreover, these models showcase limited accuracy when used in categorical classification modes. To overcome these issues, this text proposes design of a novel high-density bio inspired feature analysis deep learning model for sub-classification of natural & synthetic image sets. The proposed model initially uses a YoLo model to identify different objects in the input image sets. These objects are individually processed via a hybrid LSTM (Long Short-Term Memory), and GRU (Gated Recurrent Unit) model, which assists in estimation of high-density feature sets. These feature sets are further extended using Wavelet, Cosine, Fourier & Convolutional features for multi-domain representation of input images. These feature sets are given to an Elephant Herding Optimization (EHO) Model, which assists in identification of feature sets with high inter-class variance levels. The selected features are classified via a customized 1D CNN model, and validated via an efficient GAN classifier, that assists in classification of these sub-entities into natural & synthetic objects. These classification results are combined in order to identify if the input image is purely natural, purely synthetic, of a mixture of both types. The model also evaluates a Natural Image Score (NIS), which assists in estimation of natural content in each of the input image sets. It was observed that the proposed model showcased 8.3% higher accuracy, 10.5% higher precision, 3.9% higher recall, and 8.5% higher AUC (Area Under the Curve) performance when compared with standard classification models under real-time scenarios.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-023-16296-8</doi><tpages>26</tpages><orcidid>https://orcid.org/0000-0001-7231-1340</orcidid></addata></record> |
fulltext | fulltext |
identifier | ISSN: 1573-7721 |
ispartof | Multimedia tools and applications, 2024-03, Vol.83 (8), p.24653-24678 |
issn | 1573-7721 1380-7501 1573-7721 |
language | eng |
recordid | cdi_proquest_journals_2930092398 |
source | Springer Nature - Complete Springer Journals |
subjects | Accuracy Biomimetics Classification Computer Communication Networks Computer Science Data Structures and Information Theory Deep learning Digital imaging Graphical user interface High density Image processing Machine learning Multimedia Information Systems Special Purpose and Application-Based Systems Track 6: Computer Vision for Multimedia Applications |
title | Design of a high-density bio-inspired feature analysis deep learning model for sub-classification of natural & synthetic imagery |
url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T16%3A32%3A41IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Design%20of%20a%20high-density%20bio-inspired%20feature%20analysis%20deep%20learning%20model%20for%20sub-classification%20of%20natural%20&%20synthetic%20imagery&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Yawale,%20Nupoor&rft.date=2024-03-01&rft.volume=83&rft.issue=8&rft.spage=24653&rft.epage=24678&rft.pages=24653-24678&rft.issn=1573-7721&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-023-16296-8&rft_dat=%3Cproquest_cross%3E2930092398%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2930092398&rft_id=info:pmid/&rfr_iscdi=true |