PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION

The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis...

Ausführliche Beschreibung

Gespeichert in:
Bibliographische Detailangaben
Hauptverfasser: YEASIN, MOHAMMED, SHARMA, RAJEEV, KETTEBEKOV, SANSHZAR
Format: Patent
Sprache:eng ; fre
Schlagworte:
Online-Zugang:Volltext bestellen
Tags: Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
container_end_page
container_issue
container_start_page
container_title
container_volume
creator YEASIN, MOHAMMED
SHARMA, RAJEEV
KETTEBEKOV, SANSHZAR
description The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis of gesticulating individuals. The examples of interactive technology applications can range from information kiosks to personal computers. The video analysis of human activity provides a basis for the development of automated surveillance technologies in public places such as airports, shopping malls, and sporting events. L'invention concerne un procédé qui incorpore des repères audio et visuels issus de gestes humains en vue d'une reconnaissance automatique. Cette méthodologie articule une structure permettant de co-analyser des gestes et des éléments prosodiques des paroles d'un individu. Ladite méthodologie peut être appliquée à une plage étendue d'algorithmes impliquant une analyse d'individus faisant des gestes. Les exemples d'applications de technologies interactives s'étendent des kiosques d'informations aux ordinateurs personnels. L'analyse vidéo de l'activité humaine fournit une base pour le développement de technologies de surveillance automatisées dans des lieux publics de type aéroports, centres commerciaux, et lieux où se déroulent des événements sportifs.
format Patent
fullrecord <record><control><sourceid>epo_EVB</sourceid><recordid>TN_cdi_epo_espacenet_WO2004027685A3</recordid><sourceformat>XML</sourceformat><sourcesystem>PC</sourcesystem><sourcerecordid>WO2004027685A3</sourcerecordid><originalsourceid>FETCH-epo_espacenet_WO2004027685A33</originalsourceid><addsrcrecordid>eNrjZPAICPIP9neJVHByDHZ1UXAMdfH01w_zDA519FFw9td19HP0iQz2DFZw8w8C8cNcg5yAMu6uwSGhQa4KQa7O_u5-niGe_n48DKxpiTnFqbxQmptB2c01xNlDN7UgPz61uCAxOTUvtSQ-3N_IwMDEwMjczMLU0diYOFUAyJ8t8A</addsrcrecordid><sourcetype>Open Access Repository</sourcetype><iscdi>true</iscdi><recordtype>patent</recordtype></control><display><type>patent</type><title>PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION</title><source>esp@cenet</source><creator>YEASIN, MOHAMMED ; SHARMA, RAJEEV ; KETTEBEKOV, SANSHZAR</creator><creatorcontrib>YEASIN, MOHAMMED ; SHARMA, RAJEEV ; KETTEBEKOV, SANSHZAR</creatorcontrib><description>The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis of gesticulating individuals. The examples of interactive technology applications can range from information kiosks to personal computers. The video analysis of human activity provides a basis for the development of automated surveillance technologies in public places such as airports, shopping malls, and sporting events. L'invention concerne un procédé qui incorpore des repères audio et visuels issus de gestes humains en vue d'une reconnaissance automatique. Cette méthodologie articule une structure permettant de co-analyser des gestes et des éléments prosodiques des paroles d'un individu. Ladite méthodologie peut être appliquée à une plage étendue d'algorithmes impliquant une analyse d'individus faisant des gestes. Les exemples d'applications de technologies interactives s'étendent des kiosques d'informations aux ordinateurs personnels. L'analyse vidéo de l'activité humaine fournit une base pour le développement de technologies de surveillance automatisées dans des lieux publics de type aéroports, centres commerciaux, et lieux où se déroulent des événements sportifs.</description><edition>7</edition><language>eng ; fre</language><subject>ACOUSTICS ; ADVERTISING ; ANALOGUE COMPUTERS ; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE ; ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICESUSING STATIC MEANS TO PRESENT VARIABLE INFORMATION ; CALCULATING ; COMPUTING ; CONTROL OR REGULATING SYSTEMS IN GENERAL ; CONTROLLING ; COUNTING ; CRYPTOGRAPHY ; DIAGRAMS ; DISPLAY ; EDUCATION ; EDUCATIONAL OR DEMONSTRATION APPLIANCES ; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS ; GLOBES ; HANDLING RECORD CARRIERS ; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS ORELEMENTS ; MUSICAL INSTRUMENTS ; PHYSICS ; PLANETARIA ; PRESENTATION OF DATA ; RECOGNITION OF DATA ; RECORD CARRIERS ; REGULATING ; SEALS ; SPEECH ANALYSIS OR SYNTHESIS ; SPEECH OR AUDIO CODING OR DECODING ; SPEECH OR VOICE PROCESSING ; SPEECH RECOGNITION</subject><creationdate>2005</creationdate><oa>free_for_read</oa><woscitedreferencessubscribed>false</woscitedreferencessubscribed></display><links><openurl>$$Topenurl_article</openurl><openurlfulltext>$$Topenurlfull_article</openurlfulltext><thumbnail>$$Tsyndetics_thumb_exl</thumbnail><linktohtml>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20050113&amp;DB=EPODOC&amp;CC=WO&amp;NR=2004027685A3$$EHTML$$P50$$Gepo$$Hfree_for_read</linktohtml><link.rule.ids>230,308,776,881,25542,76290</link.rule.ids><linktorsrc>$$Uhttps://worldwide.espacenet.com/publicationDetails/biblio?FT=D&amp;date=20050113&amp;DB=EPODOC&amp;CC=WO&amp;NR=2004027685A3$$EView_record_in_European_Patent_Office$$FView_record_in_$$GEuropean_Patent_Office$$Hfree_for_read</linktorsrc></links><search><creatorcontrib>YEASIN, MOHAMMED</creatorcontrib><creatorcontrib>SHARMA, RAJEEV</creatorcontrib><creatorcontrib>KETTEBEKOV, SANSHZAR</creatorcontrib><title>PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION</title><description>The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis of gesticulating individuals. The examples of interactive technology applications can range from information kiosks to personal computers. The video analysis of human activity provides a basis for the development of automated surveillance technologies in public places such as airports, shopping malls, and sporting events. L'invention concerne un procédé qui incorpore des repères audio et visuels issus de gestes humains en vue d'une reconnaissance automatique. Cette méthodologie articule une structure permettant de co-analyser des gestes et des éléments prosodiques des paroles d'un individu. Ladite méthodologie peut être appliquée à une plage étendue d'algorithmes impliquant une analyse d'individus faisant des gestes. Les exemples d'applications de technologies interactives s'étendent des kiosques d'informations aux ordinateurs personnels. L'analyse vidéo de l'activité humaine fournit une base pour le développement de technologies de surveillance automatisées dans des lieux publics de type aéroports, centres commerciaux, et lieux où se déroulent des événements sportifs.</description><subject>ACOUSTICS</subject><subject>ADVERTISING</subject><subject>ANALOGUE COMPUTERS</subject><subject>APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE</subject><subject>ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICESUSING STATIC MEANS TO PRESENT VARIABLE INFORMATION</subject><subject>CALCULATING</subject><subject>COMPUTING</subject><subject>CONTROL OR REGULATING SYSTEMS IN GENERAL</subject><subject>CONTROLLING</subject><subject>COUNTING</subject><subject>CRYPTOGRAPHY</subject><subject>DIAGRAMS</subject><subject>DISPLAY</subject><subject>EDUCATION</subject><subject>EDUCATIONAL OR DEMONSTRATION APPLIANCES</subject><subject>FUNCTIONAL ELEMENTS OF SUCH SYSTEMS</subject><subject>GLOBES</subject><subject>HANDLING RECORD CARRIERS</subject><subject>MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS ORELEMENTS</subject><subject>MUSICAL INSTRUMENTS</subject><subject>PHYSICS</subject><subject>PLANETARIA</subject><subject>PRESENTATION OF DATA</subject><subject>RECOGNITION OF DATA</subject><subject>RECORD CARRIERS</subject><subject>REGULATING</subject><subject>SEALS</subject><subject>SPEECH ANALYSIS OR SYNTHESIS</subject><subject>SPEECH OR AUDIO CODING OR DECODING</subject><subject>SPEECH OR VOICE PROCESSING</subject><subject>SPEECH RECOGNITION</subject><fulltext>true</fulltext><rsrctype>patent</rsrctype><creationdate>2005</creationdate><recordtype>patent</recordtype><sourceid>EVB</sourceid><recordid>eNrjZPAICPIP9neJVHByDHZ1UXAMdfH01w_zDA519FFw9td19HP0iQz2DFZw8w8C8cNcg5yAMu6uwSGhQa4KQa7O_u5-niGe_n48DKxpiTnFqbxQmptB2c01xNlDN7UgPz61uCAxOTUvtSQ-3N_IwMDEwMjczMLU0diYOFUAyJ8t8A</recordid><startdate>20050113</startdate><enddate>20050113</enddate><creator>YEASIN, MOHAMMED</creator><creator>SHARMA, RAJEEV</creator><creator>KETTEBEKOV, SANSHZAR</creator><scope>EVB</scope></search><sort><creationdate>20050113</creationdate><title>PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION</title><author>YEASIN, MOHAMMED ; SHARMA, RAJEEV ; KETTEBEKOV, SANSHZAR</author></sort><facets><frbrtype>5</frbrtype><frbrgroupid>cdi_FETCH-epo_espacenet_WO2004027685A33</frbrgroupid><rsrctype>patents</rsrctype><prefilter>patents</prefilter><language>eng ; fre</language><creationdate>2005</creationdate><topic>ACOUSTICS</topic><topic>ADVERTISING</topic><topic>ANALOGUE COMPUTERS</topic><topic>APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE</topic><topic>ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICESUSING STATIC MEANS TO PRESENT VARIABLE INFORMATION</topic><topic>CALCULATING</topic><topic>COMPUTING</topic><topic>CONTROL OR REGULATING SYSTEMS IN GENERAL</topic><topic>CONTROLLING</topic><topic>COUNTING</topic><topic>CRYPTOGRAPHY</topic><topic>DIAGRAMS</topic><topic>DISPLAY</topic><topic>EDUCATION</topic><topic>EDUCATIONAL OR DEMONSTRATION APPLIANCES</topic><topic>FUNCTIONAL ELEMENTS OF SUCH SYSTEMS</topic><topic>GLOBES</topic><topic>HANDLING RECORD CARRIERS</topic><topic>MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS ORELEMENTS</topic><topic>MUSICAL INSTRUMENTS</topic><topic>PHYSICS</topic><topic>PLANETARIA</topic><topic>PRESENTATION OF DATA</topic><topic>RECOGNITION OF DATA</topic><topic>RECORD CARRIERS</topic><topic>REGULATING</topic><topic>SEALS</topic><topic>SPEECH ANALYSIS OR SYNTHESIS</topic><topic>SPEECH OR AUDIO CODING OR DECODING</topic><topic>SPEECH OR VOICE PROCESSING</topic><topic>SPEECH RECOGNITION</topic><toplevel>online_resources</toplevel><creatorcontrib>YEASIN, MOHAMMED</creatorcontrib><creatorcontrib>SHARMA, RAJEEV</creatorcontrib><creatorcontrib>KETTEBEKOV, SANSHZAR</creatorcontrib><collection>esp@cenet</collection></facets><delivery><delcategory>Remote Search Resource</delcategory><fulltext>fulltext_linktorsrc</fulltext></delivery><addata><au>YEASIN, MOHAMMED</au><au>SHARMA, RAJEEV</au><au>KETTEBEKOV, SANSHZAR</au><format>patent</format><genre>patent</genre><ristype>GEN</ristype><title>PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION</title><date>2005-01-13</date><risdate>2005</risdate><abstract>The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis of gesticulating individuals. The examples of interactive technology applications can range from information kiosks to personal computers. The video analysis of human activity provides a basis for the development of automated surveillance technologies in public places such as airports, shopping malls, and sporting events. L'invention concerne un procédé qui incorpore des repères audio et visuels issus de gestes humains en vue d'une reconnaissance automatique. Cette méthodologie articule une structure permettant de co-analyser des gestes et des éléments prosodiques des paroles d'un individu. Ladite méthodologie peut être appliquée à une plage étendue d'algorithmes impliquant une analyse d'individus faisant des gestes. Les exemples d'applications de technologies interactives s'étendent des kiosques d'informations aux ordinateurs personnels. L'analyse vidéo de l'activité humaine fournit une base pour le développement de technologies de surveillance automatisées dans des lieux publics de type aéroports, centres commerciaux, et lieux où se déroulent des événements sportifs.</abstract><edition>7</edition><oa>free_for_read</oa></addata></record>
fulltext fulltext_linktorsrc
identifier
ispartof
issn
language eng ; fre
recordid cdi_epo_espacenet_WO2004027685A3
source esp@cenet
subjects ACOUSTICS
ADVERTISING
ANALOGUE COMPUTERS
APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE
ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICESUSING STATIC MEANS TO PRESENT VARIABLE INFORMATION
CALCULATING
COMPUTING
CONTROL OR REGULATING SYSTEMS IN GENERAL
CONTROLLING
COUNTING
CRYPTOGRAPHY
DIAGRAMS
DISPLAY
EDUCATION
EDUCATIONAL OR DEMONSTRATION APPLIANCES
FUNCTIONAL ELEMENTS OF SUCH SYSTEMS
GLOBES
HANDLING RECORD CARRIERS
MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS ORELEMENTS
MUSICAL INSTRUMENTS
PHYSICS
PLANETARIA
PRESENTATION OF DATA
RECOGNITION OF DATA
RECORD CARRIERS
REGULATING
SEALS
SPEECH ANALYSIS OR SYNTHESIS
SPEECH OR AUDIO CODING OR DECODING
SPEECH OR VOICE PROCESSING
SPEECH RECOGNITION
title PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION
url https://sfx.bib-bvb.de/sfx_tum?ctx_ver=Z39.88-2004&ctx_enc=info:ofi/enc:UTF-8&ctx_tim=2025-02-02T03%3A05%3A33IST&url_ver=Z39.88-2004&url_ctx_fmt=infofi/fmt:kev:mtx:ctx&rfr_id=info:sid/primo.exlibrisgroup.com:primo3-Article-epo_EVB&rft_val_fmt=info:ofi/fmt:kev:mtx:patent&rft.genre=patent&rft.au=YEASIN,%20MOHAMMED&rft.date=2005-01-13&rft_id=info:doi/&rft_dat=%3Cepo_EVB%3EWO2004027685A3%3C/epo_EVB%3E%3Curl%3E%3C/url%3E&disable_directlink=true&sfx.directlink=off&sfx.report_link=0&rft_id=info:oai/&rft_id=info:pmid/&rfr_iscdi=true