BIG MAMA is watching you: Intelligent TV responds to gestures

Summary: BIG MAMA is watching you: Intelligent TV incorporates gesture, voice, and image recognition

Imagine a TV that responds to your physical behaviour such as finger pointing, talking and other actions such as picking up a magazine. Basically, it is a TV that watches you via gesture recognition, voice recognition and image recognition and responds accordingly.

Read more about: BIG MAMA is watching you: Intelligent TV responds to gestures

Meet Milo, a virtual agent respondiing to voice, face and gestures

Summary: Meet Milo, a virtual agent respondiing to voice, face and gestures, part of Microsofts product for Xbox360

Just wondering why I have never written about Milo, a virtual agent, conversational avatar, chatbot responding to voice, face and gestures. Very cool presentation.

 

Read more about: Meet Milo, a virtual agent respondiing to voice, face and gestures

Lip sync, facial expressions and gestures through real-time voice analysis

Summary: Steve Di Paola demonstrates a real-time, emotion aware, parametised virtual agent system to Chatbots.org. Awesome

Steve Di Paola of the Simon Fraser University demonstrated a virtual agent system to Chatbots.org.  This system interprets real time emotions in input such as voice, and shows facial expressions and gestures.

During the 9th International Conference on Intelligent Virtual Agents (related to IVA Gala), Steve showed us how his parameterized facial animation system operates. His goal is to develop a system that can handle any face type, behavior, and voice to be used in games, movies and virtual agent worlds. Their current focus is on how emotions should be expressed.

In the first few minutes of the video, he demonstrated various types of faces. Steve grabbed his microphone and started talking. The avatar spoke similar to Steve and his (or her) lips were synchronized with his words. As soon as Steve raised or changed his voice, the avatar acted correspondingly, which was absolutely amazing. It widened its mouth when talking louder; it moved its eyebrow to emphasize what it was saying, and it responded to a drumming sound. Wow!

More explanation and images after break.

 

Read more about: Lip sync, facial expressions and gestures through real-time voice analysis