PROSODY BASED AUDIO/VISUAL CO-ANALYSIS FOR CO-VERBAL GESTURE RECOGNITION

The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis...

Ausführliche Beschreibung

Gespeichert in:

Bibliographische Detailangaben
Hauptverfasser:	YEASIN, MOHAMMED, SHARMA, RAJEEV, KETTEBEKOV, SANSHZAR
Format:	Patent
Sprache:	eng ; fre
Schlagworte:	ACOUSTICS ADVERTISING ANALOGUE COMPUTERS APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND,DEAF OR MUTE ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICESUSING STATIC MEANS TO PRESENT VARIABLE INFORMATION CALCULATING COMPUTING CONTROL OR REGULATING SYSTEMS IN GENERAL CONTROLLING COUNTING CRYPTOGRAPHY DIAGRAMS DISPLAY EDUCATION EDUCATIONAL OR DEMONSTRATION APPLIANCES FUNCTIONAL ELEMENTS OF SUCH SYSTEMS GLOBES HANDLING RECORD CARRIERS MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS ORELEMENTS MUSICAL INSTRUMENTS PHYSICS PLANETARIA PRESENTATION OF DATA RECOGNITION OF DATA RECORD CARRIERS REGULATING SEALS SPEECH ANALYSIS OR SYNTHESIS SPEECH OR AUDIO CODING OR DECODING SPEECH OR VOICE PROCESSING SPEECH RECOGNITION
Online-Zugang:	Volltext bestellen
Tags:	Tag hinzufügen Keine Tags, Fügen Sie den ersten Tag hinzu!

Beschreibung
Zusammenfassung:	The present method incorporates audio and visual cues from human gesticulation for automatic recognition. The methodology articulates a framework for co-analyzing gestures and prosodic elements of a person's speech. The methodology can be applied to a wide range of algorithms involving analysis of gesticulating individuals. The examples of interactive technology applications can range from information kiosks to personal computers. The video analysis of human activity provides a basis for the development of automated surveillance technologies in public places such as airports, shopping malls, and sporting events. L'invention concerne un procédé qui incorpore des repères audio et visuels issus de gestes humains en vue d'une reconnaissance automatique. Cette méthodologie articule une structure permettant de co-analyser des gestes et des éléments prosodiques des paroles d'un individu. Ladite méthodologie peut être appliquée à une plage étendue d'algorithmes impliquant une analyse d'individus faisant des gestes. Les exemples d'applications de technologies interactives s'étendent des kiosques d'informations aux ordinateurs personnels. L'analyse vidéo de l'activité humaine fournit une base pour le développement de technologies de surveillance automatisées dans des lieux publics de type aéroports, centres commerciaux, et lieux où se déroulent des événements sportifs.