Running GLM 5.3 Flash NVFP4 inside ChatGPT: a local AI experiment
TheZachMueller · x · 2026-09-20
Developer TheZachMueller shows GLM 5.3 Flash NVFP4 running inside the ChatGPT client, calling it part of his renewed local AI experiments. He says it took significant effort and he plans to write a TIL blog post today documenting how he did it.
An atypical local-deployment combo — details pending in the blog, but it's confirmed to work.
Related event: Dev runs GLM 5.3 Flash NVFP4 locally inside ChatGPT interface(4 posts)→
More from Infra
- Show Reddit: ge, a Rust GGUF engine, benchmarks against llama.cpp on a 4GB RTX 3050 — Raptor2496 · 2026-11-12
- Musk: 100GW of space solar equals ~800GW on Earth, and ground solar needs batteries — elonmusk · 2026-11-12
- Real-world test: Kimi K3.1 Pro costs 5.4x less than Opus 5.5 per task despite 2x list-price gap — Arindam_1729 · 2026-11-12
- Dino10B: first 10-billion-scale nearest-neighbor search benchmark, 10.3TB of DINOv3 embeddings — philipvollet · 2026-11-12
- Many announced data centers may never get built, TechCrunch argues — TechCrunch AI · 2026-11-12
- Meta loses longtime infrastructure head Santosh Janardhan after 16 years — TechCrunch AI · 2026-11-12