Building Ellie: WWT's Real-Time Multilingual Digital Human

In this technical walkthrough, Fred Allen demonstrates how WWT created a sophisticated digital human named Ellie in just five weeks. Ellie is an innovative, AI-powered avatar capable of real-time, multilingual interactions. Fred explains the intricate process involving multiple technologies, including speech processing, a custom LLM for generating responses and audio-to-face technology for realistic facial animations. He details the hardware setup, software components and the seamless integration that allows Ellie to engage in context-rich conversations across languages.