Effective semantic features for facial expressions recognition using SVM

Most traditional facial expression-recognition systems track facial components such as eyes, eyebrows, and mouth for feature extraction. Though some of these features can provide clues for expression recognition, other finer changes of the facial muscles can also be deployed for classifying various...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Multimedia tools and applications 2016-06, Vol.75 (11), p.6663-6682
Hauptverfasser: Hsieh, Chen-Chiung, Hsih, Mei-Hua, Jiang, Meng-Kai, Cheng, Yun-Maw, Liang, En-Hui
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 6682
container_issue 11
container_start_page 6663
container_title Multimedia tools and applications
container_volume 75
creator Hsieh, Chen-Chiung
Hsih, Mei-Hua
Jiang, Meng-Kai
Cheng, Yun-Maw
Liang, En-Hui
description Most traditional facial expression-recognition systems track facial components such as eyes, eyebrows, and mouth for feature extraction. Though some of these features can provide clues for expression recognition, other finer changes of the facial muscles can also be deployed for classifying various facial expressions. This study locates facial components by active shape model to extract seven dynamic face regions (frown, nose wrinkle, two nasolabial folds, two eyebrows, and mouth). Proposed semantic facial features could then be acquired using directional gradient operators like Gabor filters and Laplacian of Gaussian. A multi-class support vector machine (SVM) was trained to classify six facial expressions (neutral, happiness, surprise, anger, disgust, and fear). The popular Cohn–Kanade database was tested and the average recognition rate reached 94.7 %. Also, 20 persons were invited for on-line test and the recognition rate was about 93 % in a real-world environment. It demonstrated that the proposed semantic facial features could effectively represent changes between facial expressions. The time complexity could be lower than the other SVM based approaches due to the less number of deployed features.
doi_str_mv 10.1007/s11042-015-2598-1
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_miscellaneous_1825503002</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>1825503002</sourcerecordid><originalsourceid>FETCH-LOGICAL-c349t-2150a7eb8333585c3de6932119939f1f37ec68f3934b97a46a7ae69b3e25b8f3</originalsourceid><addsrcrecordid>eNp1kEFLAzEQhYMoWKs_wNuCFy_RTLLZbI5SqhUqHixeQzZOSsp2tya7ov_elHoQwdPMPL73GB4hl8BugDF1mwBYySkDSbnUNYUjMgGpBFWKw3HeRc2okgxOyVlKG8agkryckMXce3RD-MAi4dZ2Q3CFRzuMEVPh-1h464JtC_zcZSWFvktFRNevuzDkoxhT6NbFy-vTOTnxtk148TOnZHU_X80WdPn88Di7W1InSj1QDpJZhU0thJC1dOINKy04gNZCe_BCoatqL7QoG61sWVllM9EI5LLJ-pRcH2J3sX8fMQ1mG5LDtrUd9mMyUHMpmWCMZ_TqD7rpx9jl5wwoXZWl4qrKFBwoF_uUInqzi2Fr45cBZvbVmkO1Jldr9tUayB5-8KTMdmuMv5L_NX0DPOp6iQ</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>1796447276</pqid></control><display><type>article</type><title>Effective semantic features for facial expressions recognition using SVM</title><source>SpringerLink Journals - AutoHoldings</source><creator>Hsieh, Chen-Chiung ; Hsih, Mei-Hua ; Jiang, Meng-Kai ; Cheng, Yun-Maw ; Liang, En-Hui</creator><creatorcontrib>Hsieh, Chen-Chiung ; Hsih, Mei-Hua ; Jiang, Meng-Kai ; Cheng, Yun-Maw ; Liang, En-Hui</creatorcontrib><description>Most traditional facial expression-recognition systems track facial components such as eyes, eyebrows, and mouth for feature extraction. Though some of these features can provide clues for expression recognition, other finer changes of the facial muscles can also be deployed for classifying various facial expressions. This study locates facial components by active shape model to extract seven dynamic face regions (frown, nose wrinkle, two nasolabial folds, two eyebrows, and mouth). Proposed semantic facial features could then be acquired using directional gradient operators like Gabor filters and Laplacian of Gaussian. A multi-class support vector machine (SVM) was trained to classify six facial expressions (neutral, happiness, surprise, anger, disgust, and fear). The popular Cohn–Kanade database was tested and the average recognition rate reached 94.7 %. Also, 20 persons were invited for on-line test and the recognition rate was about 93 % in a real-world environment. It demonstrated that the proposed semantic facial features could effectively represent changes between facial expressions. The time complexity could be lower than the other SVM based approaches due to the less number of deployed features.</description><identifier>ISSN: 1380-7501</identifier><identifier>EISSN: 1573-7721</identifier><identifier>DOI: 10.1007/s11042-015-2598-1</identifier><language>eng</language><publisher>New York: Springer US</publisher><subject>Algorithms ; Analysis ; Artificial intelligence ; Classification ; Communication ; Computer Communication Networks ; Computer Science ; Data Structures and Information Theory ; Deformation ; Discriminant analysis ; Face ; Face recognition ; Facial ; Feature extraction ; Feature recognition ; Image processing systems ; Mouth ; Multimedia Information Systems ; Neural networks ; Pattern recognition ; Principal components analysis ; Recognition ; Semantics ; Special Purpose and Application-Based Systems ; Studies ; Support vector machines</subject><ispartof>Multimedia tools and applications, 2016-06, Vol.75 (11), p.6663-6682</ispartof><rights>Springer Science+Business Media New York 2015</rights><rights>Springer Science+Business Media New York 2016</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c349t-2150a7eb8333585c3de6932119939f1f37ec68f3934b97a46a7ae69b3e25b8f3</citedby><cites>FETCH-LOGICAL-c349t-2150a7eb8333585c3de6932119939f1f37ec68f3934b97a46a7ae69b3e25b8f3</cites></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s11042-015-2598-1$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s11042-015-2598-1$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27923,27924,41487,42556,51318</link.rule.ids></links><search><creatorcontrib>Hsieh, Chen-Chiung</creatorcontrib><creatorcontrib>Hsih, Mei-Hua</creatorcontrib><creatorcontrib>Jiang, Meng-Kai</creatorcontrib><creatorcontrib>Cheng, Yun-Maw</creatorcontrib><creatorcontrib>Liang, En-Hui</creatorcontrib><title>Effective semantic features for facial expressions recognition using SVM</title><title>Multimedia tools and applications</title><addtitle>Multimed Tools Appl</addtitle><description>Most traditional facial expression-recognition systems track facial components such as eyes, eyebrows, and mouth for feature extraction. Though some of these features can provide clues for expression recognition, other finer changes of the facial muscles can also be deployed for classifying various facial expressions. This study locates facial components by active shape model to extract seven dynamic face regions (frown, nose wrinkle, two nasolabial folds, two eyebrows, and mouth). Proposed semantic facial features could then be acquired using directional gradient operators like Gabor filters and Laplacian of Gaussian. A multi-class support vector machine (SVM) was trained to classify six facial expressions (neutral, happiness, surprise, anger, disgust, and fear). The popular Cohn–Kanade database was tested and the average recognition rate reached 94.7 %. Also, 20 persons were invited for on-line test and the recognition rate was about 93 % in a real-world environment. It demonstrated that the proposed semantic facial features could effectively represent changes between facial expressions. The time complexity could be lower than the other SVM based approaches due to the less number of deployed features.</description><subject>Algorithms</subject><subject>Analysis</subject><subject>Artificial intelligence</subject><subject>Classification</subject><subject>Communication</subject><subject>Computer Communication Networks</subject><subject>Computer Science</subject><subject>Data Structures and Information Theory</subject><subject>Deformation</subject><subject>Discriminant analysis</subject><subject>Face</subject><subject>Face recognition</subject><subject>Facial</subject><subject>Feature extraction</subject><subject>Feature recognition</subject><subject>Image processing systems</subject><subject>Mouth</subject><subject>Multimedia Information Systems</subject><subject>Neural networks</subject><subject>Pattern recognition</subject><subject>Principal components analysis</subject><subject>Recognition</subject><subject>Semantics</subject><subject>Special Purpose and Application-Based Systems</subject><subject>Studies</subject><subject>Support vector machines</subject><issn>1380-7501</issn><issn>1573-7721</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2016</creationdate><recordtype>article</recordtype><sourceid>8G5</sourceid><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>GUQSH</sourceid><sourceid>M2O</sourceid><recordid>eNp1kEFLAzEQhYMoWKs_wNuCFy_RTLLZbI5SqhUqHixeQzZOSsp2tya7ov_elHoQwdPMPL73GB4hl8BugDF1mwBYySkDSbnUNYUjMgGpBFWKw3HeRc2okgxOyVlKG8agkryckMXce3RD-MAi4dZ2Q3CFRzuMEVPh-1h464JtC_zcZSWFvktFRNevuzDkoxhT6NbFy-vTOTnxtk148TOnZHU_X80WdPn88Di7W1InSj1QDpJZhU0thJC1dOINKy04gNZCe_BCoatqL7QoG61sWVllM9EI5LLJ-pRcH2J3sX8fMQ1mG5LDtrUd9mMyUHMpmWCMZ_TqD7rpx9jl5wwoXZWl4qrKFBwoF_uUInqzi2Fr45cBZvbVmkO1Jldr9tUayB5-8KTMdmuMv5L_NX0DPOp6iQ</recordid><startdate>20160601</startdate><enddate>20160601</enddate><creator>Hsieh, Chen-Chiung</creator><creator>Hsih, Mei-Hua</creator><creator>Jiang, Meng-Kai</creator><creator>Cheng, Yun-Maw</creator><creator>Liang, En-Hui</creator><general>Springer US</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><scope>3V.</scope><scope>7SC</scope><scope>7WY</scope><scope>7WZ</scope><scope>7XB</scope><scope>87Z</scope><scope>8AL</scope><scope>8AO</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FK</scope><scope>8FL</scope><scope>8G5</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>AZQEC</scope><scope>BENPR</scope><scope>BEZIV</scope><scope>BGLVJ</scope><scope>CCPQU</scope><scope>DWQXO</scope><scope>FRNLG</scope><scope>F~G</scope><scope>GNUQQ</scope><scope>GUQSH</scope><scope>HCIFZ</scope><scope>JQ2</scope><scope>K60</scope><scope>K6~</scope><scope>K7-</scope><scope>L.-</scope><scope>L7M</scope><scope>L~C</scope><scope>L~D</scope><scope>M0C</scope><scope>M0N</scope><scope>M2O</scope><scope>MBDVC</scope><scope>P5Z</scope><scope>P62</scope><scope>PQBIZ</scope><scope>PQBZA</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>Q9U</scope></search><sort><creationdate>20160601</creationdate><title>Effective semantic features for facial expressions recognition using SVM</title><author>Hsieh, Chen-Chiung ; Hsih, Mei-Hua ; Jiang, Meng-Kai ; Cheng, Yun-Maw ; Liang, En-Hui</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c349t-2150a7eb8333585c3de6932119939f1f37ec68f3934b97a46a7ae69b3e25b8f3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2016</creationdate><topic>Algorithms</topic><topic>Analysis</topic><topic>Artificial intelligence</topic><topic>Classification</topic><topic>Communication</topic><topic>Computer Communication Networks</topic><topic>Computer Science</topic><topic>Data Structures and Information Theory</topic><topic>Deformation</topic><topic>Discriminant analysis</topic><topic>Face</topic><topic>Face recognition</topic><topic>Facial</topic><topic>Feature extraction</topic><topic>Feature recognition</topic><topic>Image processing systems</topic><topic>Mouth</topic><topic>Multimedia Information Systems</topic><topic>Neural networks</topic><topic>Pattern recognition</topic><topic>Principal components analysis</topic><topic>Recognition</topic><topic>Semantics</topic><topic>Special Purpose and Application-Based Systems</topic><topic>Studies</topic><topic>Support vector machines</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Hsieh, Chen-Chiung</creatorcontrib><creatorcontrib>Hsih, Mei-Hua</creatorcontrib><creatorcontrib>Jiang, Meng-Kai</creatorcontrib><creatorcontrib>Cheng, Yun-Maw</creatorcontrib><creatorcontrib>Liang, En-Hui</creatorcontrib><collection>CrossRef</collection><collection>ProQuest Central (Corporate)</collection><collection>Computer and Information Systems Abstracts</collection><collection>ABI/INFORM Collection</collection><collection>ABI/INFORM Global (PDF only)</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>ABI/INFORM Global (Alumni Edition)</collection><collection>Computing Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>ABI/INFORM Collection (Alumni Edition)</collection><collection>Research Library (Alumni Edition)</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest Central Essentials</collection><collection>ProQuest Central</collection><collection>Business Premium Collection</collection><collection>Technology Collection</collection><collection>ProQuest One Community College</collection><collection>ProQuest Central Korea</collection><collection>Business Premium Collection (Alumni)</collection><collection>ABI/INFORM Global (Corporate)</collection><collection>ProQuest Central Student</collection><collection>Research Library Prep</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Computer Science Collection</collection><collection>ProQuest Business Collection (Alumni Edition)</collection><collection>ProQuest Business Collection</collection><collection>Computer Science Database</collection><collection>ABI/INFORM Professional Advanced</collection><collection>Advanced Technologies Database with Aerospace</collection><collection>Computer and Information Systems Abstracts – Academic</collection><collection>Computer and Information Systems Abstracts Professional</collection><collection>ABI/INFORM Global</collection><collection>Computing Database</collection><collection>Research Library</collection><collection>Research Library (Corporate)</collection><collection>Advanced Technologies &amp; Aerospace Database</collection><collection>ProQuest Advanced Technologies &amp; Aerospace Collection</collection><collection>ProQuest One Business</collection><collection>ProQuest One Business (Alumni)</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central Basic</collection><jtitle>Multimedia tools and applications</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Hsieh, Chen-Chiung</au><au>Hsih, Mei-Hua</au><au>Jiang, Meng-Kai</au><au>Cheng, Yun-Maw</au><au>Liang, En-Hui</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Effective semantic features for facial expressions recognition using SVM</atitle><jtitle>Multimedia tools and applications</jtitle><stitle>Multimed Tools Appl</stitle><date>2016-06-01</date><risdate>2016</risdate><volume>75</volume><issue>11</issue><spage>6663</spage><epage>6682</epage><pages>6663-6682</pages><issn>1380-7501</issn><eissn>1573-7721</eissn><abstract>Most traditional facial expression-recognition systems track facial components such as eyes, eyebrows, and mouth for feature extraction. Though some of these features can provide clues for expression recognition, other finer changes of the facial muscles can also be deployed for classifying various facial expressions. This study locates facial components by active shape model to extract seven dynamic face regions (frown, nose wrinkle, two nasolabial folds, two eyebrows, and mouth). Proposed semantic facial features could then be acquired using directional gradient operators like Gabor filters and Laplacian of Gaussian. A multi-class support vector machine (SVM) was trained to classify six facial expressions (neutral, happiness, surprise, anger, disgust, and fear). The popular Cohn–Kanade database was tested and the average recognition rate reached 94.7 %. Also, 20 persons were invited for on-line test and the recognition rate was about 93 % in a real-world environment. It demonstrated that the proposed semantic facial features could effectively represent changes between facial expressions. The time complexity could be lower than the other SVM based approaches due to the less number of deployed features.</abstract><cop>New York</cop><pub>Springer US</pub><doi>10.1007/s11042-015-2598-1</doi><tpages>20</tpages></addata></record>
fulltext fulltext
identifier ISSN: 1380-7501
ispartof Multimedia tools and applications, 2016-06, Vol.75 (11), p.6663-6682
issn 1380-7501
1573-7721
language eng
recordid cdi_proquest_miscellaneous_1825503002
source SpringerLink Journals - AutoHoldings
subjects Algorithms
Analysis
Artificial intelligence
Classification
Communication
Computer Communication Networks
Computer Science
Data Structures and Information Theory
Deformation
Discriminant analysis
Face
Face recognition
Facial
Feature extraction
Feature recognition
Image processing systems
Mouth
Multimedia Information Systems
Neural networks
Pattern recognition
Principal components analysis
Recognition
Semantics
Special Purpose and Application-Based Systems
Studies
Support vector machines
title Effective semantic features for facial expressions recognition using SVM
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-01-12T23%3A26%3A40IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Effective%20semantic%20features%20for%20facial%20expressions%20recognition%20using%20SVM&rft.jtitle=Multimedia%20tools%20and%20applications&rft.au=Hsieh,%20Chen-Chiung&rft.date=2016-06-01&rft.volume=75&rft.issue=11&rft.spage=6663&rft.epage=6682&rft.pages=6663-6682&rft.issn=1380-7501&rft.eissn=1573-7721&rft_id=info:doi/10.1007/s11042-015-2598-1&rft_dat=%3Cproquest_cross%3E1825503002%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=1796447276&rft_id=info:pmid/&rfr_iscdi=true