Particle Swarm Optimization With Probability Sequence for Global Optimization

Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:IEEE access 2020, Vol.8, p.110535-110549
Hauptverfasser: Rauf, Hafiz Tayyab, Shoaib, Umar, Lali, Muhammad Ikramullah, Alhaisoni, Majed, Irfan, Muhammad Naeem, Khan, Muhammad Attique
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 110549
container_issue
container_start_page 110535
container_title IEEE access
container_volume 8
creator Rauf, Hafiz Tayyab
Shoaib, Umar
Lali, Muhammad Ikramullah
Alhaisoni, Majed
Irfan, Muhammad Naeem
Khan, Muhammad Attique
description Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.
doi_str_mv 10.1109/ACCESS.2020.3002725
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_crossref_primary_10_1109_ACCESS_2020_3002725</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><ieee_id>9117125</ieee_id><doaj_id>oai_doaj_org_article_2cfee87ccd21488682b02f2f6804ca0d</doaj_id><sourcerecordid>2454612496</sourcerecordid><originalsourceid>FETCH-LOGICAL-c408t-2077b36006671b58d31432a19651c2d0be9dc4135b43760f594068e33cf338933</originalsourceid><addsrcrecordid>eNpVUU1Lw0AQDaJgqf0FvQQ8p85-ZLM5llBrodJCFI_LZrOrW9Ju3aRI_fVuTSk6lxnezHszw4uiMYIJQpA_TItiVpYTDBgmBABnOL2KBhixPCEpYdd_6tto1LYbCMEDlGaD6HktfWdVo-PyS_ptvNp3dmu_ZWfdLn6z3Ue89q6SlW1sd4xL_XnQO6Vj43w8b0Kj-ce4i26MbFo9Oudh9Po4eymekuVqviimy0RR4F2CIcsqwgAYy1CV8pogSrBEOUuRwjVUOq8VRSStKMkYmDSnwLgmRBlCeE7IMFr0urWTG7H3div9UThpxS_g_Ls4vyWwMlrzTKkaI8o547gCbLBhHKiSUAet-15r7134ru3Exh38LpwvME0pQ5jmLEyRfkp517Zem8tWBOJkg-htECcbxNmGwBr3LKu1vjByhDIUuj-YJIGJ</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2454612496</pqid></control><display><type>article</type><title>Particle Swarm Optimization With Probability Sequence for Global Optimization</title><source>IEEE Open Access Journals</source><source>DOAJ Directory of Open Access Journals</source><source>EZB-FREE-00999 freely available EZB journals</source><creator>Rauf, Hafiz Tayyab ; Shoaib, Umar ; Lali, Muhammad Ikramullah ; Alhaisoni, Majed ; Irfan, Muhammad Naeem ; Khan, Muhammad Attique</creator><creatorcontrib>Rauf, Hafiz Tayyab ; Shoaib, Umar ; Lali, Muhammad Ikramullah ; Alhaisoni, Majed ; Irfan, Muhammad Naeem ; Khan, Muhammad Attique</creatorcontrib><description>Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.</description><identifier>ISSN: 2169-3536</identifier><identifier>EISSN: 2169-3536</identifier><identifier>DOI: 10.1109/ACCESS.2020.3002725</identifier><identifier>CODEN: IAECCG</identifier><language>eng</language><publisher>Piscataway: IEEE</publisher><subject>Algorithms ; Artificial neural networks ; Back propagation networks ; Benchmarks ; Computer science ; Convergence ; Generators ; Global optimization ; Heuristic methods ; Neural networks ; Normal distribution ; Optimization ; Particle swarm optimization ; Population ; Probability distribution ; Probability distribution functions ; Sociology ; Statistical analysis ; Statistics ; Weibull distribution</subject><ispartof>IEEE access, 2020, Vol.8, p.110535-110549</ispartof><rights>Copyright The Institute of Electrical and Electronics Engineers, Inc. (IEEE) 2020</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c408t-2077b36006671b58d31432a19651c2d0be9dc4135b43760f594068e33cf338933</citedby><cites>FETCH-LOGICAL-c408t-2077b36006671b58d31432a19651c2d0be9dc4135b43760f594068e33cf338933</cites><orcidid>0000-0003-2208-5853</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://ieeexplore.ieee.org/document/9117125$$EHTML$$P50$$Gieee$$Hfree_for_read</linktohtml><link.rule.ids>314,780,784,864,2102,4024,27633,27923,27924,27925,54933</link.rule.ids></links><search><creatorcontrib>Rauf, Hafiz Tayyab</creatorcontrib><creatorcontrib>Shoaib, Umar</creatorcontrib><creatorcontrib>Lali, Muhammad Ikramullah</creatorcontrib><creatorcontrib>Alhaisoni, Majed</creatorcontrib><creatorcontrib>Irfan, Muhammad Naeem</creatorcontrib><creatorcontrib>Khan, Muhammad Attique</creatorcontrib><title>Particle Swarm Optimization With Probability Sequence for Global Optimization</title><title>IEEE access</title><addtitle>Access</addtitle><description>Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.</description><subject>Algorithms</subject><subject>Artificial neural networks</subject><subject>Back propagation networks</subject><subject>Benchmarks</subject><subject>Computer science</subject><subject>Convergence</subject><subject>Generators</subject><subject>Global optimization</subject><subject>Heuristic methods</subject><subject>Neural networks</subject><subject>Normal distribution</subject><subject>Optimization</subject><subject>Particle swarm optimization</subject><subject>Population</subject><subject>Probability distribution</subject><subject>Probability distribution functions</subject><subject>Sociology</subject><subject>Statistical analysis</subject><subject>Statistics</subject><subject>Weibull distribution</subject><issn>2169-3536</issn><issn>2169-3536</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2020</creationdate><recordtype>article</recordtype><sourceid>ESBDL</sourceid><sourceid>RIE</sourceid><sourceid>DOA</sourceid><recordid>eNpVUU1Lw0AQDaJgqf0FvQQ8p85-ZLM5llBrodJCFI_LZrOrW9Ju3aRI_fVuTSk6lxnezHszw4uiMYIJQpA_TItiVpYTDBgmBABnOL2KBhixPCEpYdd_6tto1LYbCMEDlGaD6HktfWdVo-PyS_ptvNp3dmu_ZWfdLn6z3Ue89q6SlW1sd4xL_XnQO6Vj43w8b0Kj-ce4i26MbFo9Oudh9Po4eymekuVqviimy0RR4F2CIcsqwgAYy1CV8pogSrBEOUuRwjVUOq8VRSStKMkYmDSnwLgmRBlCeE7IMFr0urWTG7H3div9UThpxS_g_Ls4vyWwMlrzTKkaI8o547gCbLBhHKiSUAet-15r7134ru3Exh38LpwvME0pQ5jmLEyRfkp517Zem8tWBOJkg-htECcbxNmGwBr3LKu1vjByhDIUuj-YJIGJ</recordid><startdate>2020</startdate><enddate>2020</enddate><creator>Rauf, Hafiz Tayyab</creator><creator>Shoaib, Umar</creator><creator>Lali, Muhammad Ikramullah</creator><creator>Alhaisoni, Majed</creator><creator>Irfan, Muhammad Naeem</creator><creator>Khan, Muhammad Attique</creator><general>IEEE</general><general>The Institute of Electrical and Electronics Engineers, Inc. (IEEE)</general><scope>97E</scope><scope>ESBDL</scope><scope>RIA</scope><scope>RIE</scope><scope>AAYXX</scope><scope>CITATION</scope><scope>7SC</scope><scope>7SP</scope><scope>7SR</scope><scope>8BQ</scope><scope>8FD</scope><scope>JG9</scope><scope>JQ2</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0003-2208-5853</orcidid></search><sort><creationdate>2020</creationdate><title>Particle Swarm Optimization With Probability Sequence for Global Optimization</title><author>Rauf, Hafiz Tayyab ; Shoaib, Umar ; Lali, Muhammad Ikramullah ; Alhaisoni, Majed ; Irfan, Muhammad Naeem ; Khan, Muhammad Attique</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c408t-2077b36006671b58d31432a19651c2d0be9dc4135b43760f594068e33cf338933</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2020</creationdate><topic>Algorithms</topic><topic>Artificial neural networks</topic><topic>Back propagation networks</topic><topic>Benchmarks</topic><topic>Computer science</topic><topic>Convergence</topic><topic>Generators</topic><topic>Global optimization</topic><topic>Heuristic methods</topic><topic>Neural networks</topic><topic>Normal distribution</topic><topic>Optimization</topic><topic>Particle swarm optimization</topic><topic>Population</topic><topic>Probability distribution</topic><topic>Probability distribution functions</topic><topic>Sociology</topic><topic>Statistical analysis</topic><topic>Statistics</topic><topic>Weibull distribution</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Rauf, Hafiz Tayyab</creatorcontrib><creatorcontrib>Shoaib, Umar</creatorcontrib><creatorcontrib>Lali, Muhammad Ikramullah</creatorcontrib><creatorcontrib>Alhaisoni, Majed</creatorcontrib><creatorcontrib>Irfan, Muhammad Naeem</creatorcontrib><creatorcontrib>Khan, Muhammad Attique</creatorcontrib><collection>IEEE All-Society Periodicals Package (ASPP) 2005-present</collection><collection>IEEE Open Access Journals</collection><collection>IEEE All-Society Periodicals Package (ASPP) 1998-Present</collection><collection>IEEE Electronic Library (IEL)</collection><collection>CrossRef</collection><collection>Computer and Information Systems Abstracts</collection><collection>Electronics &amp; Communications Abstracts</collection><collection>Engineered Materials Abstracts</collection><collection>METADEX</collection><collection>Technology Research Database</collection><collection>Materials Research Database</collection><collection>ProQuest Computer Science Collection</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>IEEE access</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Rauf, Hafiz Tayyab</au><au>Shoaib, Umar</au><au>Lali, Muhammad Ikramullah</au><au>Alhaisoni, Majed</au><au>Irfan, Muhammad Naeem</au><au>Khan, Muhammad Attique</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Particle Swarm Optimization With Probability Sequence for Global Optimization</atitle><jtitle>IEEE access</jtitle><stitle>Access</stitle><date>2020</date><risdate>2020</risdate><volume>8</volume><spage>110535</spage><epage>110549</epage><pages>110535-110549</pages><issn>2169-3536</issn><eissn>2169-3536</eissn><coden>IAECCG</coden><abstract>Particle Swarm Optimization (PSO) has been frequently employed to solve diversified optimization problems. Choosing initial placement for population plays an important role in meta-heuristic methods since they can significantly converge. In this study, probability distribution has been introduced to enhance the diversity of swarm and convergence speed. Population initialization method based on uniform distribution is normally used when there is no preceding knowledge available regarding the candidate solution. In this paper, a new approach to initialize population is proposed using probability sequence Weibull marked as (WI-PSO) that applies the probability distribution to generate numbers at random locations for swarm initialization. The proposed method (WI-PSO) is tested on sixteen well-known uni-modal and multi-modal benchmark test functions broadly adopted by the research community and its encouraging performance is investigated and compared with the Exponential distribution based PSO (E-PSO), Beta distribution based PSO (BT-PSO), Gamma distribution based PSO (GA-PSO) and Log-normal distribution based PSO (LN-PSO). Artificial Neural Networks (ANNs) have become the most powerful tool for classification of complex benchmark problems. We have experimented the proposed method (WI-PSO) for weight optimization of a feed-forward neural network to ensure its purity and have compared with conventional back-propagation algorithm (BPA), E-PSO, BT-PSO, GA-PSO and LN-PSO. Due to flexible behaviour in the degree of freedom, the experimental results infer the perfection and dominance of the Weibull based population initialization. The result exhibits the anticipation of influence exerted by the proposed technique on all sixteen objective functions and eight real-world benchmark data sets.</abstract><cop>Piscataway</cop><pub>IEEE</pub><doi>10.1109/ACCESS.2020.3002725</doi><tpages>15</tpages><orcidid>https://orcid.org/0000-0003-2208-5853</orcidid><oa>free_for_read</oa></addata></record>
fulltext fulltext
identifier ISSN: 2169-3536
ispartof IEEE access, 2020, Vol.8, p.110535-110549
issn 2169-3536
2169-3536
language eng
recordid cdi_crossref_primary_10_1109_ACCESS_2020_3002725
source IEEE Open Access Journals; DOAJ Directory of Open Access Journals; EZB-FREE-00999 freely available EZB journals
subjects Algorithms
Artificial neural networks
Back propagation networks
Benchmarks
Computer science
Convergence
Generators
Global optimization
Heuristic methods
Neural networks
Normal distribution
Optimization
Particle swarm optimization
Population
Probability distribution
Probability distribution functions
Sociology
Statistical analysis
Statistics
Weibull distribution
title Particle Swarm Optimization With Probability Sequence for Global Optimization
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-28T17%3A22%3A54IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Particle%20Swarm%20Optimization%20With%20Probability%20Sequence%20for%20Global%20Optimization&rft.jtitle=IEEE%20access&rft.au=Rauf,%20Hafiz%20Tayyab&rft.date=2020&rft.volume=8&rft.spage=110535&rft.epage=110549&rft.pages=110535-110549&rft.issn=2169-3536&rft.eissn=2169-3536&rft.coden=IAECCG&rft_id=info:doi/10.1109/ACCESS.2020.3002725&rft_dat=%3Cproquest_cross%3E2454612496%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2454612496&rft_id=info:pmid/&rft_ieee_id=9117125&rft_doaj_id=oai_doaj_org_article_2cfee87ccd21488682b02f2f6804ca0d&rfr_iscdi=true