Self-hosted realtime avatar server: 30 FPS to 90 FPS on a free Colab T4
SavingsWeather1659 · reddit · 2026-10-29
A developer open-sourced Bulti, a self-hosted realtime talking-avatar server built on optimized FLOAT inference: 30→90 FPS on a free Colab T4, up to 105 FPS with TensorRT, at roughly 3 GB VRAM per concurrent user. It integrates LiveKit and WebRTC for realtime voice agents and simplifies wiring to providers like OpenAI and Gemini, aiming to beat third-party avatar APIs on cost and deployment control. GitHub repo plus a Colab demo available.
Related event: Open-Source Fast-Float Pushes Talking Avatar Inference to 90 FPS on a T4(2 posts)→
More from Infra
- Sam Altman wants OpenAI robots to build data centers for AI's own expansion — VraserX · 2026-10-29
- Dual 3090s running Qwen3.8-27B INT4 is significantly faster than FP8 — Travnewmatic · 2026-10-29
- Junction: Two-Week Chip Fab Retreat in Bangalore to Train India's Semiconductor Talent — itsarnavb · 2026-10-29
- Unsloth quants run 1T-param Mistral Large 4 on Mac Studio: 1-bit keeps 91% accuracy at 223GB — danielhanchen · 2026-10-29
- Only 13% of Planned UK Data Centre Capacity Under Construction, Report Finds — ersatzben · 2026-10-29
- SMCI-backed neocloud Argentum AI seeks $5B credit facility for chip purchases — Beth_Kindig · 2026-10-29