Qwen3.8-27B runs 100k-token physics simulation on a 16GB GPU
1000_bucks_a_month · reddit · 2026-08-26
A developer ran a heavily quantized Qwen3.8-27B model (IQ3XXS) on an older 16GB Quadro RTX 5000, tasking it with implementing the coherent optical transfer-matrix method (TMM) for multilayer films from scratch. The session lasted about 100 minutes, generating 108,000 output tokens and undergoing three context compaction attempts.
Key Details:
- Hardware: NVIDIA Quadro RTX 5000 (16GB), Intel Xeon Silver 4116, 256GB RAM.
- Config: Used Unsloth Dynamic V3 quantization with a custom DFlash2 llama.cpp build and Flash Attention enabled.
- Process: The model produced 43,000 tokens in the first 27 minutes and wrote tmm.py. The core implementation was correct early on, but the model spent the remaining time debugging its own broken validators, repeatedly re-deriving conventions and getting stuck in contradictions.
- Conclusion: Despite heavy quantization and VRAM constraints, the model can handle hardcore scientific computing over extremely long contexts, though its self-consistency verification process can be highly inefficient.
More from coding & agent
- Claude Code Frontend Design Toolkit: 70+ Skills, Plugins and MCP Servers to Kill AI Slop — tom_doerr · 2026-08-26
- An "Artificial Civilization Scaffold" Could Make AI Smarter Without Any Retraining — New_User_1970 · 2026-08-26
- Idea: Build a Social Network Where Agents Roast and Collaborate — RileyRalmuto · 2026-08-26
- CoArena offers free tool to benchmark computer-use agents via head-to-head tasks — Independent-Laugh701 · 2026-08-26
- Paper reveals Agent benchmark unreliability: Harness variance 7.8x model variance — omarsar0 · 2026-08-26
- Swarms Launches MCP Server and Ecosystem Updates — KyeGomezB · 2026-08-26