Interacting with Santos™: Gestures and wireless Pocket PCs
Key features needed for creating a successful digital human are the ability for real people to interact with Santos™ to be provided with a means for interacting with real. The classical way to interact with a digital human is through a mouse and keyboard. Santos™, however, is being developed to support many new devices which allows a more intuitive interaction. These devices include voice and gesture recognition so the user can talk to Santos™ instead of entering commands on a keyboard. Optical tracking devices are used to allow Santos™ to see users and understand their movements. A wireless Pocket PC has been developed to act as an interactive remote control.
Visualization of Santos™ is also important. He is being developed in many different environments: web-based version,simple desktop computer, single wall with passive stereo, and a complex 6-wall virtual reality cube with active stereo.
A natural way to communicate with Santos™ is through voice. Our windows based XP voice recognition software includes advanced speech-recognition functionality in all, enabling users of the Santos™ environment to enter and manipulate data, postures, and execute commands as well as control menus by speaking into a microphone. It is envisioned that this toolkit will facilitate the implementation of Santos™ in other industries.
