● Covered by 1 source · 1 reportLow impact1 neutral
NVIDIA Nemotron Voice Agent Powers Interactive Halloween Projection
Key points
- MonsterHouse is an interactive Halloween projection.
- Uses NVIDIA Nemotron Voice Agent for conversation.
- Nemotron ASR handles speech-to-text, Bolt E4B for replies.
- Magpie TTS Zeroshot provides voice, Audio2Face-3D animates mouth.
- Runs on a single workstation with NVIDIA RTX PRO GPUs.
MonsterHouse: An Interactive Halloween Display
A Halloween projection called MonsterHouse was developed to create an interactive experience for trick-or-treaters. The system projects a grumpy, talking mouth onto a garage door, which interacts with visitors. The house responds in the voice of a pirate and softens its demeanor when visitors use polite language.
NVIDIA AI Technologies Utilized
The MonsterHouse project integrates several NVIDIA AI technologies. NVIDIA Nemotron Voice Agent provides the conversational framework. NVIDIA Nemotron 3 ASR (nemotron-speech-streaming-en-0.6b.q8_0.gguf) converts visitor speech to text. NVIDIA Nemotron 3.5 Bolt E4B 4GB, an open small language model, generates replies, with a LoRA adapter defining the personality. NVIDIA Magpie TTS Zeroshot voices the replies using a character reference sample, and NVIDIA Audio2Face-3D animates the projected mouth in Unreal Engine 5.
Additional AI Components and Hardware
Beyond conversation and animation, the system also uses NVIDIA Nemotron 3 Nano Omni for costume description and YOLO with ByteTrack for visitor counting and tracking. The entire setup operates on a single workstation equipped with an NVIDIA RTX PRO 6000 Blackwell Max-Q and an NVIDIA RTX PRO 4000 Blackwell GPU.
Visual Design and Animation
The visual aspect of MonsterHouse involved creating a custom animation rig for the garage door's mouth. Facial expression shapes were exported for Audio2Face-3D animation. The character SkelMesh was built in Autodesk Maya and then integrated into Unreal Engine, where virtual fire and effects were added behind the door to enhance the visual effect.
✨ This summary was generated by AI from the outlets' reporting listed below. It is not independently verified and may contain errors — check the original sources. How BrevFeed works →
The daily brief
One email each morning: the day's tech stories, clustered across outlets and summarized. No account needed.
One email a day. Unsubscribe in one click, any time.
Today's brief
Spend a few minutes, get the whole day. Every topic's top stories in one hands-free rundown — listen, watch, or read the transcript.
▶ Play today's brief
New every morning, and the back catalogue is archived by date.
Reporting from
An interactive Halloween projection named MonsterHouse was created using NVIDIA's Nemotron Voice Agent, Nemotron ASR, Nemotron 3.5 Bolt E4B 4GB, Magpie TTS Zeroshot, and Audio2Face-3D. The system allows a garage door to listen to trick-or-treaters, respond as a grumpy pirate, and animate a mouth. This project demonstrates the practical application of NVIDIA's AI tools for real-time conversational agents and animation in a creative context.