HeyGen Open-Sources Real-Time AI Avatar Framework Built on OpenAI's GPT-Live, With Language Tutor Demo
HeyGen · x · 2026-09-11
HeyGen announced an open-source reference framework for real-time AI experiences, built with OpenAI and combining GPT-Live (a full-duplex speech-to-speech model), LiveAvatar, and HyperFrames.
The repo ships a minimal, readable integration: out of the box it's a Japanese tutor that speaks words aloud, renders term cards (term · pronunciation · meaning) on screen as animated overlays, and periodically minimizes itself to recap everything taught — driven by the server's session record, not the model's memory.
Personas are just two markdown files in server/prompts/, and each visual is one tool plus one composition, so swapping them turns it into any other demo. The code is intentionally barebones — the wiring is the thing you read.
Related event: HeyGen and OpenAI Open-Source Real-Time AI Avatar Framework(2 posts)→
More from coding & agent
- Claude Managed Agents adds session viewer: attach ant CLI to live agent sessions — ClaudeDevs · 2026-09-11
- webmcp is a bridge, not the end state — the web will go truly agentic — EdenEmarco177 · 2026-09-11
- Tencent open-sources WeKnora, a RAG knowledge platform with 22k GitHub stars — abhishek__AI · 2026-09-11
- Tencent open-sources WeKnora, a RAG platform turning scattered docs into reasoning knowledge bases — abhishek__AI · 2026-09-11
- One Pokédex, four model setups: hands-on comparison of GPT-6 Astra and DeepSeek V4.1 Flash — kevinkern · 2026-09-11
- Agent Arena launches leaderboard grading models on millions of real agentic tasks — arena · 2026-09-11