110 likes | 222 Vues
This research presentation by Francesca Barrientos at UC Berkeley discusses the integration of nonverbal behaviors in virtual environments, focusing on avatars. It explores how gestures, posture, gaze, and other nonverbal cues enhance communication alongside speech. The study examines previous approaches to natural language inference and proposes methods for automatic animation that synchronize user movements with avatar actions. It highlights the significance of expressive satisfaction and engagement in interaction design. Avatars serve as effective surrogate bodies, facilitating richer virtual communication.
E N D
Communicating withAvatar Bodies Francesca Barrientos Computer ScienceUC Berkeley 8 July 1999HCC Research Retreat
ComicChat Oz blaxxun Avatar worlds
Nonverbal behaviors • Gesture • Proxemics • Posture • Facial expression • Gaze • Context • Appearance • ...
(Nivi waves to Harry.) Previous approaches Natural Language Inference Expression selection Automatic animation
Interfaces for controlling animation of nonverbal behaviors verbal communication through audio continuous control Understand how user movements translate onto avatar bodies Beyond chat
Part of meaning of gesture comes from its co-ocurrence with speech Rhythm, flow, stroke, force, shape… Importance of synchrony
Evaluation • Depends on task • Ease of use • Expressive satisfaction • Level of interaction engagement • Emergent communicative behaviors
Network issues • Synchronizing control and audio data
Summary • Avatars allow communication using surrogate bodies • Gesture and speech are coexpressive • Design tool: virtual prototypes for PRoP design