RTX 5090 Demo: Running Qwen 3.8 27B Locally at 115 tok/s
rohanpaul_ai · x · 2026-08-17
Rohan Paul shared a demo of running Qwen 3.8 27B locally on a system with an RTX 5090 (32GB VRAM), achieving a speed of 115 tokens/sec. Notably, the model's official BF16 checkpoint is 55.6 GB, suggesting the demo likely utilized a quantized version to fit within the 32GB memory limit.
Related event: Qwen3.8-27B local benchmarks: from RTX 4080 Super to RTX 6000 Pro(7 posts)→
More from Embodied
- EmbodiedEvo tops RoboDojo as agents inherit reusable skills and lessons — Aiden_Tech_Ai · 2026-10-16
- Sunday Robotics is hiring a Senior Infra PM to scale consumer robot deployments — saranormous · 2026-10-16
- Bond's Submarine Lotus Esprit Spotted at Event, Fueling Steering-Wheel-Free Robotaxi Speculation — PTrubey · 2026-10-16
- Maker wires Grok and Claude into ROS2 robot with RealSense stereo cameras — chrismatthieu · 2026-10-16
- NEURA Robotics launches Neuron AI, a unified Perception-Language-Action model for robots — Distinct-Question-16 · 2026-10-16
- Dev demos open wearable AI passport running multilingual flashcards on tiny memory — ezshine · 2026-10-16