Understanding Coverbal Iconic Gestures in Shape Descriptions - Couverture souple

Sowa, Timo

Couverture souple

ISBN 10 : 389838294X ISBN 13 : 9783898382946

Editeur : Akademische Verlagsgesellschaft AKA, 2006

Synopsis

Gestures are a powerful communication medium which has also been found to make human-machine communication more natural. As the hands can be used to express shape flexibly and immediately in the spatial medium, gestures are an ideal modality for describing pictorial content.

This thesis investigates the principles according to which gesture and speech express shape-related content and presents a computational approach towards the interpretation of such multimodal expressions. For that purpose a corpus of speech-gesture shape descriptions acquired from an empirical study is described and analyzed. The empirical results are used to inform a formal representation model for a unified description of shape conveyed via gesture and speech. Building on this, an implemented process model is described which can algorithmically interpret input from the two modalities and generate an internal representation of shape.

Détails de l'édition

• Éditeur: Akademische Verlagsgesellschaft AKA
• Date d'édition: 2006
• Langue: anglais
• ISBN 10: 389838294X
• ISBN 13: 9783898382946
• Reliure: Taschenbuch
• Numéro d'édition: 1
• Nombre de pages: 276
• Coordonnées du fabricant: non disponible
• Personne responsable: non disponible