Conscious observational behavior in recognizing landmarks in facial expressions
The present study investigated (1) how well humans can recognize facial expressions represented by a small set of landmarks, a commonly used technique in facial recognition in machine learning and (2) differences in conscious observational behaviors to recognized different types of expressions. Our...
Gespeichert in:
| Veröffentlicht in: | PloS one 2023-10, Vol.18 (10), p.e0291735-e0291735 |
|---|---|
| Hauptverfasser: | , |
| Format: | Artikel |
| Sprache: | eng |
| Schlagworte: | |
| Online-Zugang: | Volltext |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| container_end_page | e0291735 |
|---|---|
| container_issue | 10 |
| container_start_page | e0291735 |
| container_title | PloS one |
| container_volume | 18 |
| creator | Xu, Kuangzhe Matsuka, Toshihiko |
| description | The present study investigated (1) how well humans can recognize facial expressions represented by a small set of landmarks, a commonly used technique in facial recognition in machine learning and (2) differences in conscious observational behaviors to recognized different types of expressions. Our video stimuli consisted of facial expression represented by 68 landmark points. Conscious observational behaviors were measured by movements of the mouse cursor where a small area around it was only visible to participants. We constructed Bayesian models to analyze how personality traits and observational behaviors influenced how participants recognized different facial expressions. We found that humans could recognize positive expressions with high accuracy, similar to machine learning, even when faces were represented by a small set of landmarks. Although humans fared better than machine learning, recognition of negative expressions was not as high as positives. Our results also showed that personality traits and conscious observational behaviors significantly influenced recognizing facial expressions. For example, people with high agreeableness could correctly recognize faces expressing happiness by observing several areas among faces without focusing on any specific part for very long. These results suggest a mechanism whereby personality traits lead to different conscious observational behaviors and recognitions of facial expressions are based on information obtained through those observational behaviors. |
| doi_str_mv | 10.1371/journal.pone.0291735 |
| format | Article |
| fullrecord | <record><control><sourceid>gale_plos_</sourceid><recordid>TN_cdi_plos_journals_2872776355</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><galeid>A767746516</galeid><doaj_id>oai_doaj_org_article_c1a49ef73184433a9878a29eb4348759</doaj_id><sourcerecordid>A767746516</sourcerecordid><originalsourceid>FETCH-LOGICAL-c670t-c87ee6952bb60b5e9f75a0df791a1fc830963ef7a4fa7782d800cb1d4615d283</originalsourceid><addsrcrecordid>eNqNkl2L1DAUhoso7jr6DwQLgujFjPlovq5kGfwYWBjQxduQpqedjJ1mTNph9debOlW2sheSi4ST57wneXmz7DlGK0wFfrv3Q-hMuzr6DlaIKCwoe5BdYkXJkhNEH945X2RPYtwjxKjk_HF2QYVQRGB6mW3XvovW-SHmvowQTqZ3PsnmJezMyfmQuy4PYH3TuZ-ua_LWdNXBhG9xvKiNdYmF22OAGFNjfJo9qk0b4dm0L7KbD-9v1p-W19uPm_XV9dJygfqllQKAK0bKkqOSgaoFM6iqhcIG11ZSpDiFWpiiNkJIUkmEbImrgmNWEUkX2Yuz7LH1UU9WRE2kIEJwylgiNmei8mavj8GlR__Q3jj9u-BDo03onW1BW2wKlYZRLIuCUqOkkIYoKAtaSMFU0no3TRvKA1QWuj6YdiY6v-ncTjf-pDFiDGFOk8LrSSH47wPEXh9ctNAmNyF5Pz6cEkYLhBP68h_0_u9NVGPSD1xX-zTYjqL6SnAhCs7S3EW2uodKq4KDsyk4tUv1WcObWUNierjtGzPEqDdfPv8_u_06Z1_dYXdg2n4XfTuMYYtzsDiDNvgYA9R_XcZIj7n_44Yec6-n3NNfamTzZg</addsrcrecordid><sourcetype>Open Website</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>2872776355</pqid></control><display><type>article</type><title>Conscious observational behavior in recognizing landmarks in facial expressions</title><source>DOAJ Directory of Open Access Journals</source><source>Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals</source><source>Public Library of Science (PLoS) Journals Open Access</source><source>PubMed Central</source><source>Free Full-Text Journals in Chemistry</source><creator>Xu, Kuangzhe ; Matsuka, Toshihiko</creator><contributor>Mahesh, Vijayalakshmi G V</contributor><creatorcontrib>Xu, Kuangzhe ; Matsuka, Toshihiko ; Mahesh, Vijayalakshmi G V</creatorcontrib><description>The present study investigated (1) how well humans can recognize facial expressions represented by a small set of landmarks, a commonly used technique in facial recognition in machine learning and (2) differences in conscious observational behaviors to recognized different types of expressions. Our video stimuli consisted of facial expression represented by 68 landmark points. Conscious observational behaviors were measured by movements of the mouse cursor where a small area around it was only visible to participants. We constructed Bayesian models to analyze how personality traits and observational behaviors influenced how participants recognized different facial expressions. We found that humans could recognize positive expressions with high accuracy, similar to machine learning, even when faces were represented by a small set of landmarks. Although humans fared better than machine learning, recognition of negative expressions was not as high as positives. Our results also showed that personality traits and conscious observational behaviors significantly influenced recognizing facial expressions. For example, people with high agreeableness could correctly recognize faces expressing happiness by observing several areas among faces without focusing on any specific part for very long. These results suggest a mechanism whereby personality traits lead to different conscious observational behaviors and recognitions of facial expressions are based on information obtained through those observational behaviors.</description><identifier>ISSN: 1932-6203</identifier><identifier>EISSN: 1932-6203</identifier><identifier>DOI: 10.1371/journal.pone.0291735</identifier><identifier>PMID: 37792713</identifier><language>eng</language><publisher>San Francisco: Public Library of Science</publisher><subject>Accuracy ; Analysis ; Bayesian analysis ; Behavior ; Biology and Life Sciences ; Biometry ; Computer and Information Sciences ; Emotions ; Evaluation ; Experiments ; Eye movements ; Face ; Face recognition ; Facial expression ; Happiness ; Human acts ; Human behavior ; Learning algorithms ; Machine learning ; Mathematical models ; Medicine and Health Sciences ; Mouse devices ; Pattern recognition ; Personality ; Personality traits ; Social Sciences</subject><ispartof>PloS one, 2023-10, Vol.18 (10), p.e0291735-e0291735</ispartof><rights>COPYRIGHT 2023 Public Library of Science</rights><rights>2023 Xu, Matsuka. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><rights>2023 Xu, Matsuka 2023 Xu, Matsuka</rights><rights>2023 Xu, Matsuka. This is an open access article distributed under the terms of the Creative Commons Attribution License: http://creativecommons.org/licenses/by/4.0/ (the “License”), which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited. Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.</rights><lds50>peer_reviewed</lds50><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed><citedby>FETCH-LOGICAL-c670t-c87ee6952bb60b5e9f75a0df791a1fc830963ef7a4fa7782d800cb1d4615d283</citedby><cites>FETCH-LOGICAL-c670t-c87ee6952bb60b5e9f75a0df791a1fc830963ef7a4fa7782d800cb1d4615d283</cites><orcidid>0000-0002-0486-3642</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10550163/pdf/$$EPDF$$P50$$Gpubmedcentral$$Hfree_for_read</linktopdf><linktohtml>$$Uhttps://www.ncbi.nlm.nih.gov/pmc/articles/PMC10550163/$$EHTML$$P50$$Gpubmedcentral$$Hfree_for_read</linktohtml><link.rule.ids>230,315,728,781,785,865,886,2103,2929,23868,27926,27927,53793,53795</link.rule.ids></links><search><contributor>Mahesh, Vijayalakshmi G V</contributor><creatorcontrib>Xu, Kuangzhe</creatorcontrib><creatorcontrib>Matsuka, Toshihiko</creatorcontrib><title>Conscious observational behavior in recognizing landmarks in facial expressions</title><title>PloS one</title><description>The present study investigated (1) how well humans can recognize facial expressions represented by a small set of landmarks, a commonly used technique in facial recognition in machine learning and (2) differences in conscious observational behaviors to recognized different types of expressions. Our video stimuli consisted of facial expression represented by 68 landmark points. Conscious observational behaviors were measured by movements of the mouse cursor where a small area around it was only visible to participants. We constructed Bayesian models to analyze how personality traits and observational behaviors influenced how participants recognized different facial expressions. We found that humans could recognize positive expressions with high accuracy, similar to machine learning, even when faces were represented by a small set of landmarks. Although humans fared better than machine learning, recognition of negative expressions was not as high as positives. Our results also showed that personality traits and conscious observational behaviors significantly influenced recognizing facial expressions. For example, people with high agreeableness could correctly recognize faces expressing happiness by observing several areas among faces without focusing on any specific part for very long. These results suggest a mechanism whereby personality traits lead to different conscious observational behaviors and recognitions of facial expressions are based on information obtained through those observational behaviors.</description><subject>Accuracy</subject><subject>Analysis</subject><subject>Bayesian analysis</subject><subject>Behavior</subject><subject>Biology and Life Sciences</subject><subject>Biometry</subject><subject>Computer and Information Sciences</subject><subject>Emotions</subject><subject>Evaluation</subject><subject>Experiments</subject><subject>Eye movements</subject><subject>Face</subject><subject>Face recognition</subject><subject>Facial expression</subject><subject>Happiness</subject><subject>Human acts</subject><subject>Human behavior</subject><subject>Learning algorithms</subject><subject>Machine learning</subject><subject>Mathematical models</subject><subject>Medicine and Health Sciences</subject><subject>Mouse devices</subject><subject>Pattern recognition</subject><subject>Personality</subject><subject>Personality traits</subject><subject>Social Sciences</subject><issn>1932-6203</issn><issn>1932-6203</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2023</creationdate><recordtype>article</recordtype><sourceid>ABUWG</sourceid><sourceid>AFKRA</sourceid><sourceid>AZQEC</sourceid><sourceid>BENPR</sourceid><sourceid>CCPQU</sourceid><sourceid>DWQXO</sourceid><sourceid>GNUQQ</sourceid><sourceid>DOA</sourceid><recordid>eNqNkl2L1DAUhoso7jr6DwQLgujFjPlovq5kGfwYWBjQxduQpqedjJ1mTNph9debOlW2sheSi4ST57wneXmz7DlGK0wFfrv3Q-hMuzr6DlaIKCwoe5BdYkXJkhNEH945X2RPYtwjxKjk_HF2QYVQRGB6mW3XvovW-SHmvowQTqZ3PsnmJezMyfmQuy4PYH3TuZ-ua_LWdNXBhG9xvKiNdYmF22OAGFNjfJo9qk0b4dm0L7KbD-9v1p-W19uPm_XV9dJygfqllQKAK0bKkqOSgaoFM6iqhcIG11ZSpDiFWpiiNkJIUkmEbImrgmNWEUkX2Yuz7LH1UU9WRE2kIEJwylgiNmei8mavj8GlR__Q3jj9u-BDo03onW1BW2wKlYZRLIuCUqOkkIYoKAtaSMFU0no3TRvKA1QWuj6YdiY6v-ncTjf-pDFiDGFOk8LrSSH47wPEXh9ctNAmNyF5Pz6cEkYLhBP68h_0_u9NVGPSD1xX-zTYjqL6SnAhCs7S3EW2uodKq4KDsyk4tUv1WcObWUNierjtGzPEqDdfPv8_u_06Z1_dYXdg2n4XfTuMYYtzsDiDNvgYA9R_XcZIj7n_44Yec6-n3NNfamTzZg</recordid><startdate>20231004</startdate><enddate>20231004</enddate><creator>Xu, Kuangzhe</creator><creator>Matsuka, Toshihiko</creator><general>Public Library of Science</general><general>Public Library of Science (PLoS)</general><scope>AAYXX</scope><scope>CITATION</scope><scope>IOV</scope><scope>ISR</scope><scope>3V.</scope><scope>7QG</scope><scope>7QL</scope><scope>7QO</scope><scope>7RV</scope><scope>7SN</scope><scope>7SS</scope><scope>7T5</scope><scope>7TG</scope><scope>7TM</scope><scope>7U9</scope><scope>7X2</scope><scope>7X7</scope><scope>7XB</scope><scope>88E</scope><scope>8AO</scope><scope>8C1</scope><scope>8FD</scope><scope>8FE</scope><scope>8FG</scope><scope>8FH</scope><scope>8FI</scope><scope>8FJ</scope><scope>8FK</scope><scope>ABJCF</scope><scope>ABUWG</scope><scope>AFKRA</scope><scope>ARAPS</scope><scope>ATCPS</scope><scope>AZQEC</scope><scope>BBNVY</scope><scope>BENPR</scope><scope>BGLVJ</scope><scope>BHPHI</scope><scope>C1K</scope><scope>CCPQU</scope><scope>D1I</scope><scope>DWQXO</scope><scope>FR3</scope><scope>FYUFA</scope><scope>GHDGH</scope><scope>GNUQQ</scope><scope>H94</scope><scope>HCIFZ</scope><scope>K9.</scope><scope>KB.</scope><scope>KB0</scope><scope>KL.</scope><scope>L6V</scope><scope>LK8</scope><scope>M0K</scope><scope>M0S</scope><scope>M1P</scope><scope>M7N</scope><scope>M7P</scope><scope>M7S</scope><scope>NAPCQ</scope><scope>P5Z</scope><scope>P62</scope><scope>P64</scope><scope>PATMY</scope><scope>PDBOC</scope><scope>PIMPY</scope><scope>PQEST</scope><scope>PQQKQ</scope><scope>PQUKI</scope><scope>PRINS</scope><scope>PTHSS</scope><scope>PYCSY</scope><scope>RC3</scope><scope>7X8</scope><scope>5PM</scope><scope>DOA</scope><orcidid>https://orcid.org/0000-0002-0486-3642</orcidid></search><sort><creationdate>20231004</creationdate><title>Conscious observational behavior in recognizing landmarks in facial expressions</title><author>Xu, Kuangzhe ; Matsuka, Toshihiko</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c670t-c87ee6952bb60b5e9f75a0df791a1fc830963ef7a4fa7782d800cb1d4615d283</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2023</creationdate><topic>Accuracy</topic><topic>Analysis</topic><topic>Bayesian analysis</topic><topic>Behavior</topic><topic>Biology and Life Sciences</topic><topic>Biometry</topic><topic>Computer and Information Sciences</topic><topic>Emotions</topic><topic>Evaluation</topic><topic>Experiments</topic><topic>Eye movements</topic><topic>Face</topic><topic>Face recognition</topic><topic>Facial expression</topic><topic>Happiness</topic><topic>Human acts</topic><topic>Human behavior</topic><topic>Learning algorithms</topic><topic>Machine learning</topic><topic>Mathematical models</topic><topic>Medicine and Health Sciences</topic><topic>Mouse devices</topic><topic>Pattern recognition</topic><topic>Personality</topic><topic>Personality traits</topic><topic>Social Sciences</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Xu, Kuangzhe</creatorcontrib><creatorcontrib>Matsuka, Toshihiko</creatorcontrib><collection>CrossRef</collection><collection>Gale In Context: Opposing Viewpoints</collection><collection>Gale In Context: Science</collection><collection>ProQuest Central (Corporate)</collection><collection>Animal Behavior Abstracts</collection><collection>Bacteriology Abstracts (Microbiology B)</collection><collection>Biotechnology Research Abstracts</collection><collection>Nursing & Allied Health Database</collection><collection>Ecology Abstracts</collection><collection>Entomology Abstracts (Full archive)</collection><collection>Immunology Abstracts</collection><collection>Meteorological & Geoastrophysical Abstracts</collection><collection>Nucleic Acids Abstracts</collection><collection>Virology and AIDS Abstracts</collection><collection>Agricultural Science Collection</collection><collection>Health & Medical Collection</collection><collection>ProQuest Central (purchase pre-March 2016)</collection><collection>Medical Database (Alumni Edition)</collection><collection>ProQuest Pharma Collection</collection><collection>Public Health Database</collection><collection>Technology Research Database</collection><collection>ProQuest SciTech Collection</collection><collection>ProQuest Technology Collection</collection><collection>ProQuest Natural Science Collection</collection><collection>Hospital Premium Collection</collection><collection>Hospital Premium Collection (Alumni Edition)</collection><collection>ProQuest Central (Alumni) (purchase pre-March 2016)</collection><collection>Materials Science & Engineering Collection</collection><collection>ProQuest Central (Alumni Edition)</collection><collection>ProQuest Central UK/Ireland</collection><collection>Advanced Technologies & Aerospace Collection</collection><collection>Agricultural & Environmental Science Collection</collection><collection>ProQuest Central Essentials</collection><collection>Biological Science Collection</collection><collection>ProQuest Central</collection><collection>Technology Collection</collection><collection>Natural Science Collection</collection><collection>Environmental Sciences and Pollution Management</collection><collection>ProQuest One Community College</collection><collection>ProQuest Materials Science Collection</collection><collection>ProQuest Central Korea</collection><collection>Engineering Research Database</collection><collection>Health Research Premium Collection</collection><collection>Health Research Premium Collection (Alumni)</collection><collection>ProQuest Central Student</collection><collection>AIDS and Cancer Research Abstracts</collection><collection>SciTech Premium Collection</collection><collection>ProQuest Health & Medical Complete (Alumni)</collection><collection>Materials Science Database</collection><collection>Nursing & Allied Health Database (Alumni Edition)</collection><collection>Meteorological & Geoastrophysical Abstracts - Academic</collection><collection>ProQuest Engineering Collection</collection><collection>ProQuest Biological Science Collection</collection><collection>Agricultural Science Database</collection><collection>Health & Medical Collection (Alumni Edition)</collection><collection>Medical Database</collection><collection>Algology Mycology and Protozoology Abstracts (Microbiology C)</collection><collection>Biological Science Database</collection><collection>Engineering Database</collection><collection>Nursing & Allied Health Premium</collection><collection>Advanced Technologies & Aerospace Database</collection><collection>ProQuest Advanced Technologies & Aerospace Collection</collection><collection>Biotechnology and BioEngineering Abstracts</collection><collection>Environmental Science Database</collection><collection>Materials Science Collection</collection><collection>Publicly Available Content Database</collection><collection>ProQuest One Academic Eastern Edition (DO NOT USE)</collection><collection>ProQuest One Academic</collection><collection>ProQuest One Academic UKI Edition</collection><collection>ProQuest Central China</collection><collection>Engineering Collection</collection><collection>Environmental Science Collection</collection><collection>Genetics Abstracts</collection><collection>MEDLINE - Academic</collection><collection>PubMed Central (Full Participant titles)</collection><collection>DOAJ Directory of Open Access Journals</collection><jtitle>PloS one</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Xu, Kuangzhe</au><au>Matsuka, Toshihiko</au><au>Mahesh, Vijayalakshmi G V</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>Conscious observational behavior in recognizing landmarks in facial expressions</atitle><jtitle>PloS one</jtitle><date>2023-10-04</date><risdate>2023</risdate><volume>18</volume><issue>10</issue><spage>e0291735</spage><epage>e0291735</epage><pages>e0291735-e0291735</pages><issn>1932-6203</issn><eissn>1932-6203</eissn><abstract>The present study investigated (1) how well humans can recognize facial expressions represented by a small set of landmarks, a commonly used technique in facial recognition in machine learning and (2) differences in conscious observational behaviors to recognized different types of expressions. Our video stimuli consisted of facial expression represented by 68 landmark points. Conscious observational behaviors were measured by movements of the mouse cursor where a small area around it was only visible to participants. We constructed Bayesian models to analyze how personality traits and observational behaviors influenced how participants recognized different facial expressions. We found that humans could recognize positive expressions with high accuracy, similar to machine learning, even when faces were represented by a small set of landmarks. Although humans fared better than machine learning, recognition of negative expressions was not as high as positives. Our results also showed that personality traits and conscious observational behaviors significantly influenced recognizing facial expressions. For example, people with high agreeableness could correctly recognize faces expressing happiness by observing several areas among faces without focusing on any specific part for very long. These results suggest a mechanism whereby personality traits lead to different conscious observational behaviors and recognitions of facial expressions are based on information obtained through those observational behaviors.</abstract><cop>San Francisco</cop><pub>Public Library of Science</pub><pmid>37792713</pmid><doi>10.1371/journal.pone.0291735</doi><tpages>e0291735</tpages><orcidid>https://orcid.org/0000-0002-0486-3642</orcidid><oa>free_for_read</oa></addata></record> |
| fulltext | fulltext |
| identifier | ISSN: 1932-6203 |
| ispartof | PloS one, 2023-10, Vol.18 (10), p.e0291735-e0291735 |
| issn | 1932-6203 1932-6203 |
| language | eng |
| recordid | cdi_plos_journals_2872776355 |
| source | DOAJ Directory of Open Access Journals; Elektronische Zeitschriftenbibliothek - Frei zugängliche E-Journals; Public Library of Science (PLoS) Journals Open Access; PubMed Central; Free Full-Text Journals in Chemistry |
| subjects | Accuracy Analysis Bayesian analysis Behavior Biology and Life Sciences Biometry Computer and Information Sciences Emotions Evaluation Experiments Eye movements Face Face recognition Facial expression Happiness Human acts Human behavior Learning algorithms Machine learning Mathematical models Medicine and Health Sciences Mouse devices Pattern recognition Personality Personality traits Social Sciences |
| title | Conscious observational behavior in recognizing landmarks in facial expressions |
| url | https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-18T11%3A02%3A17IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-gale_plos_&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=Conscious%20observational%20behavior%20in%20recognizing%20landmarks%20in%20facial%20expressions&rft.jtitle=PloS%20one&rft.au=Xu,%20Kuangzhe&rft.date=2023-10-04&rft.volume=18&rft.issue=10&rft.spage=e0291735&rft.epage=e0291735&rft.pages=e0291735-e0291735&rft.issn=1932-6203&rft.eissn=1932-6203&rft_id=info:doi/10.1371/journal.pone.0291735&rft_dat=%3Cgale_plos_%3EA767746516%3C/gale_plos_%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=2872776355&rft_id=info:pmid/37792713&rft_galeid=A767746516&rft_doaj_id=oai_doaj_org_article_c1a49ef73184433a9878a29eb4348759&rfr_iscdi=true |