HeyGen Open-Sources Real-Time AI Avatar Framework Built on OpenAI's GPT-Live, With Language Tutor Demo
HeyGen · x · 2026-09-11
HeyGen announced an open-source reference framework for real-time AI experiences, built with OpenAI and combining GPT-Live (a full-duplex speech-to-speech model), LiveAvatar, and HyperFrames.
The repo ships a minimal, readable integration: out of the box it's a Japanese tutor that speaks words aloud, renders term cards (term · pronunciation · meaning) on screen as animated overlays, and periodically minimizes itself to recap everything taught — driven by the server's session record, not the model's memory.
Personas are just two markdown files in server/prompts/, and each visual is one tool plus one composition, so swapping them turns it into any other demo. The code is intentionally barebones — the wiring is the thing you read.
More from coding & agent
- Spring AI 2.1.0-RC1 adds tool-call confirmation, pausing agent loops before real-data access — therealdanvega · 2026-10-26
- 250 Builders Hack With Codex at Berlin Community Hackathon Ahead of OpenAI DevDay — paw_lean · 2026-10-26
- Building AI bots on raw APIs? Devs say models are 'dumb without the harness' — madeofAjala · 2026-10-26
- HarnessMM cuts agent tokens per task by up to 88% while raising success rates — omarsar0 · 2026-10-26
- Microsoft demos intent-classifying agents built with Copilot App and Foundry, deployable across Teams and Outlook — marlene_zw · 2026-10-26
- Looking for a wearable mic with best battery life that feeds recordings to personal agents via MCP — altryne · 2026-10-26