TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses

Massive open online courses (MOOCs) have become a popular platform owing to their open nature. However, the shortage of emotional interaction in MOOCs can cause a high attrition rate among learners. Appropriate emotional expression can enhance knowledge delivery and students’ learning performance. T...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Veröffentlicht in:Journal of visualization 2024, Vol.27 (4), p.749-764
Hauptverfasser: Kui, Xiaoyan, Zhang, Mingkun, liu, Qiang, Wang, Zixiao, Huang, Guiping, Zheng, Zhihao, Xia, Jiazhi, Zhang, Chao
Format: Artikel
Sprache:eng
Schlagworte:
Online-Zugang:Volltext
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page 764
container_issue 4
container_start_page 749
container_title Journal of visualization
container_volume 27
creator Kui, Xiaoyan
Zhang, Mingkun
liu, Qiang
Wang, Zixiao
Huang, Guiping
Zheng, Zhihao
Xia, Jiazhi
Zhang, Chao
description Massive open online courses (MOOCs) have become a popular platform owing to their open nature. However, the shortage of emotional interaction in MOOCs can cause a high attrition rate among learners. Appropriate emotional expression can enhance knowledge delivery and students’ learning performance. To tackle this issue, exploring the correlation between teachers’ emotions and students’ learning behaviors is of great value for instructors to understand how their emotions can impact students’ learning performance and improve their teaching skills. However, manually watching and studying MOOCs videos are often tedious and time-consuming. There is a lack of efficient methods to help users conduct correlation exploration, which is challenging due to the large-scale, multi-dimensional, and time-series nature of students’ learning behaviors and their complex correlation to teachers’ multimodal emotions. In this paper, we propose an interactive visual system called TSSeer to facilitate correlation analysis in MOOCs videos. Specifically, the level view and correlation view allow users to obtain a quick overview of the correlation at different video levels. The detail view shows detailed temporal changes and enables a deeper understanding of the correlation with time-series visualization. Through comprehensive evaluations, including two usage scenarios and five expert interviews, the effectiveness and usefulness of TSSeer are demonstrated. Graphical abstract
doi_str_mv 10.1007/s12650-024-00988-w
format Article
fullrecord <record><control><sourceid>proquest_cross</sourceid><recordid>TN_cdi_proquest_journals_3074787595</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>3074787595</sourcerecordid><originalsourceid>FETCH-LOGICAL-c270t-66938b697e141d239f2ea1ac98032dd81e022bec51c8d68dd05d730aa3e07d8b3</originalsourceid><addsrcrecordid>eNp9kcFu1DAURSNEJUrbH2BliXXg2U5ihx2qoFSq1EXbteXEbxhXiR38nBm64zfY8ml8CZ4OEjtWfrLOvc--t6recHjHAdR74qJroQbR1AC91vX-RXXKtWpr3av2ZZllI2tdLl5Vr4keAQRvFD-tft3f3SGmD8yynafVTswGOz1lPxKzy5KiHbdsExPD78sUkw9fWd4iG2NKONnsY2AD5j1iYBkLi4l-__jJ5nXKfo6u-OEcD1ixC45RXh2G_MwMuLU7HxMxH9hsifwOWVyKUwyTD4clayKk8-pkYyfCi7_nWfXw-dP95Zf65vbq-vLjTT0KBbnuul7qoesV8oY7IfuNQMvt2GuQwjnNEYQYcGz5qF2nnYPWKQnWSgTl9CDPqrdH3_LrbytSNo_lASUNMhJUo0p4fVsocaTGFIkSbsyS_GzTk-FgDl2YYxemdGGeuzD7IpJHES2HCDH9s_6P6g-d9JN7</addsrcrecordid><sourcetype>Aggregation Database</sourcetype><iscdi>true</iscdi><recordtype>article</recordtype><pqid>3074787595</pqid></control><display><type>article</type><title>TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses</title><source>SpringerLink Journals - AutoHoldings</source><creator>Kui, Xiaoyan ; Zhang, Mingkun ; liu, Qiang ; Wang, Zixiao ; Huang, Guiping ; Zheng, Zhihao ; Xia, Jiazhi ; Zhang, Chao</creator><creatorcontrib>Kui, Xiaoyan ; Zhang, Mingkun ; liu, Qiang ; Wang, Zixiao ; Huang, Guiping ; Zheng, Zhihao ; Xia, Jiazhi ; Zhang, Chao</creatorcontrib><description>Massive open online courses (MOOCs) have become a popular platform owing to their open nature. However, the shortage of emotional interaction in MOOCs can cause a high attrition rate among learners. Appropriate emotional expression can enhance knowledge delivery and students’ learning performance. To tackle this issue, exploring the correlation between teachers’ emotions and students’ learning behaviors is of great value for instructors to understand how their emotions can impact students’ learning performance and improve their teaching skills. However, manually watching and studying MOOCs videos are often tedious and time-consuming. There is a lack of efficient methods to help users conduct correlation exploration, which is challenging due to the large-scale, multi-dimensional, and time-series nature of students’ learning behaviors and their complex correlation to teachers’ multimodal emotions. In this paper, we propose an interactive visual system called TSSeer to facilitate correlation analysis in MOOCs videos. Specifically, the level view and correlation view allow users to obtain a quick overview of the correlation at different video levels. The detail view shows detailed temporal changes and enables a deeper understanding of the correlation with time-series visualization. Through comprehensive evaluations, including two usage scenarios and five expert interviews, the effectiveness and usefulness of TSSeer are demonstrated. Graphical abstract</description><identifier>ISSN: 1343-8875</identifier><identifier>EISSN: 1875-8975</identifier><identifier>DOI: 10.1007/s12650-024-00988-w</identifier><language>eng</language><publisher>Berlin/Heidelberg: Springer Berlin Heidelberg</publisher><subject>Classical and Continuum Physics ; Computer Imaging ; Correlation analysis ; Emotions ; Engineering ; Engineering Fluid Dynamics ; Engineering Thermodynamics ; Heat and Mass Transfer ; Interactive systems ; Learning ; Online instruction ; Pattern Recognition and Graphics ; Regular Paper ; Students ; Teachers ; Time series ; Video ; Vision</subject><ispartof>Journal of visualization, 2024, Vol.27 (4), p.749-764</ispartof><rights>The Visualization Society of Japan 2024. Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.</rights><lds50>peer_reviewed</lds50><woscitedreferencessubscribed>false</woscitedreferencessubscribed><cites>FETCH-LOGICAL-c270t-66938b697e141d239f2ea1ac98032dd81e022bec51c8d68dd05d730aa3e07d8b3</cites><orcidid>0000-0002-1469-9911</orcidid></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktopdf>$$Uhttps://link.springer.com/content/pdf/10.1007/s12650-024-00988-w$$EPDF$$P50$$Gspringer$$H</linktopdf><linktohtml>$$Uhttps://link.springer.com/10.1007/s12650-024-00988-w$$EHTML$$P50$$Gspringer$$H</linktohtml><link.rule.ids>314,780,784,27924,27925,41488,42557,51319</link.rule.ids></links><search><creatorcontrib>Kui, Xiaoyan</creatorcontrib><creatorcontrib>Zhang, Mingkun</creatorcontrib><creatorcontrib>liu, Qiang</creatorcontrib><creatorcontrib>Wang, Zixiao</creatorcontrib><creatorcontrib>Huang, Guiping</creatorcontrib><creatorcontrib>Zheng, Zhihao</creatorcontrib><creatorcontrib>Xia, Jiazhi</creatorcontrib><creatorcontrib>Zhang, Chao</creatorcontrib><title>TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses</title><title>Journal of visualization</title><addtitle>J Vis</addtitle><description>Massive open online courses (MOOCs) have become a popular platform owing to their open nature. However, the shortage of emotional interaction in MOOCs can cause a high attrition rate among learners. Appropriate emotional expression can enhance knowledge delivery and students’ learning performance. To tackle this issue, exploring the correlation between teachers’ emotions and students’ learning behaviors is of great value for instructors to understand how their emotions can impact students’ learning performance and improve their teaching skills. However, manually watching and studying MOOCs videos are often tedious and time-consuming. There is a lack of efficient methods to help users conduct correlation exploration, which is challenging due to the large-scale, multi-dimensional, and time-series nature of students’ learning behaviors and their complex correlation to teachers’ multimodal emotions. In this paper, we propose an interactive visual system called TSSeer to facilitate correlation analysis in MOOCs videos. Specifically, the level view and correlation view allow users to obtain a quick overview of the correlation at different video levels. The detail view shows detailed temporal changes and enables a deeper understanding of the correlation with time-series visualization. Through comprehensive evaluations, including two usage scenarios and five expert interviews, the effectiveness and usefulness of TSSeer are demonstrated. Graphical abstract</description><subject>Classical and Continuum Physics</subject><subject>Computer Imaging</subject><subject>Correlation analysis</subject><subject>Emotions</subject><subject>Engineering</subject><subject>Engineering Fluid Dynamics</subject><subject>Engineering Thermodynamics</subject><subject>Heat and Mass Transfer</subject><subject>Interactive systems</subject><subject>Learning</subject><subject>Online instruction</subject><subject>Pattern Recognition and Graphics</subject><subject>Regular Paper</subject><subject>Students</subject><subject>Teachers</subject><subject>Time series</subject><subject>Video</subject><subject>Vision</subject><issn>1343-8875</issn><issn>1875-8975</issn><fulltext>true</fulltext><rsrctype>article</rsrctype><creationdate>2024</creationdate><recordtype>article</recordtype><recordid>eNp9kcFu1DAURSNEJUrbH2BliXXg2U5ihx2qoFSq1EXbteXEbxhXiR38nBm64zfY8ml8CZ4OEjtWfrLOvc--t6recHjHAdR74qJroQbR1AC91vX-RXXKtWpr3av2ZZllI2tdLl5Vr4keAQRvFD-tft3f3SGmD8yynafVTswGOz1lPxKzy5KiHbdsExPD78sUkw9fWd4iG2NKONnsY2AD5j1iYBkLi4l-__jJ5nXKfo6u-OEcD1ixC45RXh2G_MwMuLU7HxMxH9hsifwOWVyKUwyTD4clayKk8-pkYyfCi7_nWfXw-dP95Zf65vbq-vLjTT0KBbnuul7qoesV8oY7IfuNQMvt2GuQwjnNEYQYcGz5qF2nnYPWKQnWSgTl9CDPqrdH3_LrbytSNo_lASUNMhJUo0p4fVsocaTGFIkSbsyS_GzTk-FgDl2YYxemdGGeuzD7IpJHES2HCDH9s_6P6g-d9JN7</recordid><startdate>2024</startdate><enddate>2024</enddate><creator>Kui, Xiaoyan</creator><creator>Zhang, Mingkun</creator><creator>liu, Qiang</creator><creator>Wang, Zixiao</creator><creator>Huang, Guiping</creator><creator>Zheng, Zhihao</creator><creator>Xia, Jiazhi</creator><creator>Zhang, Chao</creator><general>Springer Berlin Heidelberg</general><general>Springer Nature B.V</general><scope>AAYXX</scope><scope>CITATION</scope><orcidid>https://orcid.org/0000-0002-1469-9911</orcidid></search><sort><creationdate>2024</creationdate><title>TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses</title><author>Kui, Xiaoyan ; Zhang, Mingkun ; liu, Qiang ; Wang, Zixiao ; Huang, Guiping ; Zheng, Zhihao ; Xia, Jiazhi ; Zhang, Chao</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-LOGICAL-c270t-66938b697e141d239f2ea1ac98032dd81e022bec51c8d68dd05d730aa3e07d8b3</frbrgroupid><rsrctype>articles</rsrctype><prefilter>articles</prefilter><language>eng</language><creationdate>2024</creationdate><topic>Classical and Continuum Physics</topic><topic>Computer Imaging</topic><topic>Correlation analysis</topic><topic>Emotions</topic><topic>Engineering</topic><topic>Engineering Fluid Dynamics</topic><topic>Engineering Thermodynamics</topic><topic>Heat and Mass Transfer</topic><topic>Interactive systems</topic><topic>Learning</topic><topic>Online instruction</topic><topic>Pattern Recognition and Graphics</topic><topic>Regular Paper</topic><topic>Students</topic><topic>Teachers</topic><topic>Time series</topic><topic>Video</topic><topic>Vision</topic><toplevel>peer_reviewed</toplevel><toplevel>online_resources</toplevel><creatorcontrib>Kui, Xiaoyan</creatorcontrib><creatorcontrib>Zhang, Mingkun</creatorcontrib><creatorcontrib>liu, Qiang</creatorcontrib><creatorcontrib>Wang, Zixiao</creatorcontrib><creatorcontrib>Huang, Guiping</creatorcontrib><creatorcontrib>Zheng, Zhihao</creatorcontrib><creatorcontrib>Xia, Jiazhi</creatorcontrib><creatorcontrib>Zhang, Chao</creatorcontrib><collection>CrossRef</collection><jtitle>Journal of visualization</jtitle></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext</fulltext></delivery><addata><au>Kui, Xiaoyan</au><au>Zhang, Mingkun</au><au>liu, Qiang</au><au>Wang, Zixiao</au><au>Huang, Guiping</au><au>Zheng, Zhihao</au><au>Xia, Jiazhi</au><au>Zhang, Chao</au><format>journal</format><genre>article</genre><ristype>JOUR</ristype><atitle>TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses</atitle><jtitle>Journal of visualization</jtitle><stitle>J Vis</stitle><date>2024</date><risdate>2024</risdate><volume>27</volume><issue>4</issue><spage>749</spage><epage>764</epage><pages>749-764</pages><issn>1343-8875</issn><eissn>1875-8975</eissn><abstract>Massive open online courses (MOOCs) have become a popular platform owing to their open nature. However, the shortage of emotional interaction in MOOCs can cause a high attrition rate among learners. Appropriate emotional expression can enhance knowledge delivery and students’ learning performance. To tackle this issue, exploring the correlation between teachers’ emotions and students’ learning behaviors is of great value for instructors to understand how their emotions can impact students’ learning performance and improve their teaching skills. However, manually watching and studying MOOCs videos are often tedious and time-consuming. There is a lack of efficient methods to help users conduct correlation exploration, which is challenging due to the large-scale, multi-dimensional, and time-series nature of students’ learning behaviors and their complex correlation to teachers’ multimodal emotions. In this paper, we propose an interactive visual system called TSSeer to facilitate correlation analysis in MOOCs videos. Specifically, the level view and correlation view allow users to obtain a quick overview of the correlation at different video levels. The detail view shows detailed temporal changes and enables a deeper understanding of the correlation with time-series visualization. Through comprehensive evaluations, including two usage scenarios and five expert interviews, the effectiveness and usefulness of TSSeer are demonstrated. Graphical abstract</abstract><cop>Berlin/Heidelberg</cop><pub>Springer Berlin Heidelberg</pub><doi>10.1007/s12650-024-00988-w</doi><tpages>16</tpages><orcidid>https://orcid.org/0000-0002-1469-9911</orcidid></addata></record>
fulltext fulltext
identifier ISSN: 1343-8875
ispartof Journal of visualization, 2024, Vol.27 (4), p.749-764
issn 1343-8875
1875-8975
language eng
recordid cdi_proquest_journals_3074787595
source SpringerLink Journals - AutoHoldings
subjects Classical and Continuum Physics
Computer Imaging
Correlation analysis
Emotions
Engineering
Engineering Fluid Dynamics
Engineering Thermodynamics
Heat and Mass Transfer
Interactive systems
Learning
Online instruction
Pattern Recognition and Graphics
Regular Paper
Students
Teachers
Time series
Video
Vision
title TSSeer: a visual analytics approach for exploring the correlation between teachers’ multimodal emotions and students’ behaviors in massive open online courses
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2024-12-25T14%3A37%3A38IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-proquest_cross&rft_val_fmt=info:ofi/fmt:kev:mtx:journal&rft.genre=article&rft.atitle=TSSeer:%20a%20visual%20analytics%20approach%20for%20exploring%20the%20correlation%20between%20teachers%E2%80%99%20multimodal%20emotions%20and%20students%E2%80%99%20behaviors%20in%20massive%20open%20online%20courses&rft.jtitle=Journal%20of%20visualization&rft.au=Kui,%20Xiaoyan&rft.date=2024&rft.volume=27&rft.issue=4&rft.spage=749&rft.epage=764&rft.pages=749-764&rft.issn=1343-8875&rft.eissn=1875-8975&rft_id=info:doi/10.1007/s12650-024-00988-w&rft_dat=%3Cproquest_cross%3E3074787595%3C/proquest_cross%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_pqid=3074787595&rft_id=info:pmid/&rfr_iscdi=true