Janas and Colibri Run 80B MoE Models on a Mini PC and Colab's L4, Why No Hype?
Chrono_Tri · reddit · 2026-11-19
A r/LocalLLaMA user tested two under-the-radar open-source tools, Janas and Colibri, that make huge MoE models runnable on low-end hardware, and asks why they aren't getting attention.
Janas
- Ran Qwen3-30B-A3B (JNS) on a GMKtec M5 Plus mini PC (32GB RAM), eating nearly all RAM but working; surprisingly good for novel writing and instant translation
- On Colab L4, GPU usage was 0 (Vulkan only) yet it still ran Qwen3-Next-80B-A3B well
- Requires format conversion (fast); likely can't handle 100K-context coding
Colibri
- CUDA-only, untested locally; ran an 80B GGUF model on Colab L4 using only 19GB VRAM
OP suspects vibe coding at 100K context won't work and invites community input on pros, cons, and alternatives.
More from Infra
- Anthropic seeks 10,000 MW of compute from SpaceX, Musk reveals hours before its IPO — RachelVT42 · 2026-11-19
- Claims China leads on orbital compute: satellites already flying, $8B pledged — RachelVT42 · 2026-11-19
- KAIST Proposes PROLA: Low-Rank Adaptation for Spatiotemporal Weather Downscaling — MLVLab · 2026-11-19
- MIT's QDA uses LLM agents to auto-design quantization, beating best public recipes — mit-han-lab · 2026-11-19
- WSJ: Wall Street pledged $500B for Nvidia but hasn't put up a dime — GaryMarcus · 2026-11-19
- Bypassing PyTorch with HIP kernels makes MiniMax H3 up to 3x faster on AMD R9700 — Apprehensive_Sky892 · 2026-11-19