VR conference control system and method based on face modeling and expression tracking

The invention discloses a VR conference control system and method based on face modeling and expression tracking, and the system comprises a conference scene selection module, a face detection module,a feature point extraction module, a 3D face model generation module, a facial expression tracking m...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: SHEN MUSHENG, YAN MINGYUE, HE BAOHUA
Format: Patent
Sprache:chi ; eng
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator SHEN MUSHENG
YAN MINGYUE
HE BAOHUA
description The invention discloses a VR conference control system and method based on face modeling and expression tracking, and the system comprises a conference scene selection module, a face detection module,a feature point extraction module, a 3D face model generation module, a facial expression tracking module, and an interaction module, wherein the conference scene selection module is used for entering a conference scene according to the user's selection; the face detection module is used for recognizing face information of a wearer; the facial expression tracking module is used for obtaining a plurality of feature points in the face information every other preset time period and mapping the feature points into the 3D face model in real time, and the interaction module is used for outputting aconference scene and the 3D face model. According to the invention, the real-time change of each feature point in the face information can be accurately updated to the 3D face model in real time, i.e., the expression change o
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_CN111881807A</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>CN111881807A</sourcerecordid><originalsourceid>FETCH-epo_espacenet_CN111881807A3</originalsourceid><addsrcrecordid>eNqNjD0KAjEUhNNYiHqH5wEEg4VpZVGsLES2XWIy0cX8kZdCb28UD2A1w3wfMxV9fyaTokNBNPjUWpInfnFFIB0tBdR7snTVDEspktPNC8nCj_H2NfDMBcxjg7Vo82j7XEyc9ozFL2diedhfuuMKOQ3g3D4i6tCdpJRKSbXe7jb_OG_9rDlt</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>VR conference control system and method based on face modeling and expression tracking</title><source>esp@cenet</source><creator>SHEN MUSHENG ; YAN MINGYUE ; HE BAOHUA</creator><creatorcontrib>SHEN MUSHENG ; YAN MINGYUE ; HE BAOHUA</creatorcontrib><description>The invention discloses a VR conference control system and method based on face modeling and expression tracking, and the system comprises a conference scene selection module, a face detection module,a feature point extraction module, a 3D face model generation module, a facial expression tracking module, and an interaction module, wherein the conference scene selection module is used for entering a conference scene according to the user's selection; the face detection module is used for recognizing face information of a wearer; the facial expression tracking module is used for obtaining a plurality of feature points in the face information every other preset time period and mapping the feature points into the 3D face model in real time, and the interaction module is used for outputting aconference scene and the 3D face model. According to the invention, the real-time change of each feature point in the face information can be accurately updated to the 3D face model in real time, i.e., the expression change o</description><language>chi ; eng</language><subject>CALCULATING ; COMPUTING ; COUNTING ; ELECTRIC COMMUNICATION TECHNIQUE ; ELECTRICITY ; HANDLING RECORD CARRIERS ; IMAGE DATA PROCESSING OR GENERATION, IN GENERAL ; PHYSICS ; PICTORIAL COMMUNICATION, e.g. TELEVISION ; PRESENTATION OF DATA ; RECOGNITION OF DATA ; RECORD CARRIERS</subject><creationdate>2020</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20201103&amp;DB=EPODOC&amp;CC=CN&amp;NR=111881807A$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,776,881,25542,76289</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20201103&amp;DB=EPODOC&amp;CC=CN&amp;NR=111881807A$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>SHEN MUSHENG</creatorcontrib><creatorcontrib>YAN MINGYUE</creatorcontrib><creatorcontrib>HE BAOHUA</creatorcontrib><title>VR conference control system and method based on face modeling and expression tracking</title><description>The invention discloses a VR conference control system and method based on face modeling and expression tracking, and the system comprises a conference scene selection module, a face detection module,a feature point extraction module, a 3D face model generation module, a facial expression tracking module, and an interaction module, wherein the conference scene selection module is used for entering a conference scene according to the user's selection; the face detection module is used for recognizing face information of a wearer; the facial expression tracking module is used for obtaining a plurality of feature points in the face information every other preset time period and mapping the feature points into the 3D face model in real time, and the interaction module is used for outputting aconference scene and the 3D face model. According to the invention, the real-time change of each feature point in the face information can be accurately updated to the 3D face model in real time, i.e., the expression change o</description><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>COUNTING</subject><subject>ELECTRIC COMMUNICATION TECHNIQUE</subject><subject>ELECTRICITY</subject><subject>HANDLING RECORD CARRIERS</subject><subject>IMAGE DATA PROCESSING OR GENERATION, IN GENERAL</subject><subject>PHYSICS</subject><subject>PICTORIAL COMMUNICATION, e.g. TELEVISION</subject><subject>PRESENTATION OF DATA</subject><subject>RECOGNITION OF DATA</subject><subject>RECORD CARRIERS</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2020</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNqNjD0KAjEUhNNYiHqH5wEEg4VpZVGsLES2XWIy0cX8kZdCb28UD2A1w3wfMxV9fyaTokNBNPjUWpInfnFFIB0tBdR7snTVDEspktPNC8nCj_H2NfDMBcxjg7Vo82j7XEyc9ozFL2diedhfuuMKOQ3g3D4i6tCdpJRKSbXe7jb_OG_9rDlt</recordid><startdate>20201103</startdate><enddate>20201103</enddate><creator>SHEN MUSHENG</creator><creator>YAN MINGYUE</creator><creator>HE BAOHUA</creator><scope>EVB</scope></search><sort><creationdate>20201103</creationdate><title>VR conference control system and method based on face modeling and expression tracking</title><author>SHEN MUSHENG ; YAN MINGYUE ; HE BAOHUA</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_CN111881807A3</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>chi ; eng</language><creationdate>2020</creationdate><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>COUNTING</topic><topic>ELECTRIC COMMUNICATION TECHNIQUE</topic><topic>ELECTRICITY</topic><topic>HANDLING RECORD CARRIERS</topic><topic>IMAGE DATA PROCESSING OR GENERATION, IN GENERAL</topic><topic>PHYSICS</topic><topic>PICTORIAL COMMUNICATION, e.g. TELEVISION</topic><topic>PRESENTATION OF DATA</topic><topic>RECOGNITION OF DATA</topic><topic>RECORD CARRIERS</topic><toplevel>online_resources</toplevel><creatorcontrib>SHEN MUSHENG</creatorcontrib><creatorcontrib>YAN MINGYUE</creatorcontrib><creatorcontrib>HE BAOHUA</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>SHEN MUSHENG</au><au>YAN MINGYUE</au><au>HE BAOHUA</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>VR conference control system and method based on face modeling and expression tracking</title><date>2020-11-03</date><risdate>2020</risdate><abstract>The invention discloses a VR conference control system and method based on face modeling and expression tracking, and the system comprises a conference scene selection module, a face detection module,a feature point extraction module, a 3D face model generation module, a facial expression tracking module, and an interaction module, wherein the conference scene selection module is used for entering a conference scene according to the user's selection; the face detection module is used for recognizing face information of a wearer; the facial expression tracking module is used for obtaining a plurality of feature points in the face information every other preset time period and mapping the feature points into the 3D face model in real time, and the interaction module is used for outputting aconference scene and the 3D face model. According to the invention, the real-time change of each feature point in the face information can be accurately updated to the 3D face model in real time, i.e., the expression change o</abstract><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language chi ; eng
recordid cdi_epo_espacenet_CN111881807A
source esp@cenet
subjects CALCULATING
COMPUTING
COUNTING
ELECTRIC COMMUNICATION TECHNIQUE
ELECTRICITY
HANDLING RECORD CARRIERS
IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
PHYSICS
PICTORIAL COMMUNICATION, e.g. TELEVISION
PRESENTATION OF DATA
RECOGNITION OF DATA
RECORD CARRIERS
title VR conference control system and method based on face modeling and expression tracking
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-06T13%3A46%3A05IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=SHEN%20MUSHENG&rft.date=2020-11-03&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3ECN111881807A%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true