Ant and Tsinghua open-source Realtime-Venus, an OpenAI Realtime API alternative
aigclink · x · 2026-10-16
Ant Group and Tsinghua released Realtime-Venus, an open-source alternative to OpenAI's Realtime API: a real-time multimodal agent system that continuously listens, watches, and speaks while executing complex tasks in the background.
Key points:
- Dual-loop architecture splits real-time interaction and long-running tasks into two parallel pipelines, built from two 9B models plus a Harness
- Realtime-Venus-Omni continuously perceives audio/video input
- Realtime-Venus-Audio handles native full-duplex voice
- Realtime-Venus-Harness delegates reasoning, search, and tool calls to the background, returning results into the live conversation
Users no longer need to pause conversations while the AI works. The system is particularly relevant for smart glasses and in-car assistants, turning real-time agents from a voice interface into an environment-aware assistant.
More from coding & agent
- Products now sell twice: first to agents, then to humans who trust them — FinanceYF5 · 2026-10-16
- Manus laid out the AI agent blueprint back in March 2025 — FinanceYF5 · 2026-10-16
- Sentry CEO shares screenshot of AI agent talking back to a human in code review — zeeg · 2026-10-16
- SWE-Duel: self-scaling adversarial arena has coding agents hide and catch bugs — Consistent_Fox_2990 · 2026-10-16
- Turn your Claude Code and Codex agent traces into training-ready SFT datasets for small open models — Rasmic · 2026-10-16
- LangChain dev: auto-generating evals from prod traces only gets you regression tests — BraceSproul · 2026-10-16