WWT Senior Software Engineer Joshua Coffman walks through how Nova was built — from ASR and LLMs to RAG, TTS and real-time rendering — all running on a single workstation, offline capable.

See Nova in action as it engages in real-time conversation and explains complex topics in plain language.

In this technical walkthrough, Fred Allen demonstrates how WWT created a sophisticated digital human named Ellie in just five weeks. Ellie is an innovative, AI-powered avatar capable of real-time, multilingual interactions. Fred explains the intricate process involving multiple technologies, including speech processing, a custom LLM for generating responses and audio-to-face technology for realistic facial animations. He details the hardware setup, software components and the seamless integration that allows Ellie to engage in context-rich conversations across languages. 

Fred Allen III, Software Engineer, gives a demonstration of Ellie, a digital human developed in the AI Proving Ground. This digital human is based on the NVIDIA​ AI Blueprint for building digital humans.​​ It can be deployed as a fully self-contained solution at the edge or scaled on-demand in corporate or cloud data centers. Its digital human knowledge base is customizable.