AAAI Publications, Ninth Artificial Intelligence and Interactive Digital Entertainment Conference

Font Size: 
Creating Playable Social Experiences through Whole-Body Interaction with Virtual Characters
Daniel G. Shapiro, Josh McCoy, April Grow, Ben Samuel, Andrew Stern, Reid Swanson, Mike Treanor, Michael Mateas

Last modified: 2013-11-13


This paper describes work towards the goal of enabling unscripted interaction with non-player characters in virtual environments.  We hypothesize that we can define a layer of social affordances, based on physical and non-verbal signals exchanged between individuals and groups, which can be reused across games.  We have implemented a first version of that substrate that employs whole body interaction with virtual characters and generates nuanced, real-time character performance in response.  We describe the playable experience produced by the system, the implementation architecture (based on the behavior specification technology used in Façade, the social model employed in Prom Week, and gesture recognition technology), and illustrate the key behaviors and programming idioms that enable character performance.  These idioms include orthogonal coding of attitudes and activities, use of relational rules to nominate social behavior, use of volition rules to rank options, and priority based interleaving of character animations.


Social Reasoning and Agency; Authoring Tools; Interactive Drama and Story Generation; Virtual/Mixed Reality; Architecture; Training/Simulation; Group/Team Behavior; Personality; Gesture

Full Text: PDF