"Jev at Home": Open-Source Clone Runs Real-Time on Laptop CPU via Distillation
frjj-slm · reddit · 2026-09-30
Reddit user frjj-slm built an open-source clone of Jev optimized for CPU inference, after finding no existing version.
- Runs in real time on a laptop CPU (AMD Ryzen AI 9 HX PRO 370), except for the larger models
- Follows a similar MLM adaptation and post-training approach as Laya, but replaces RL with soft-label distillation from a Qwen3.5-4B teacher, arguing RL was overkill just to prevent overconfident outputs
- Repo, model weights, and post-training decision dataset are all public on GitHub and Hugging Face
More from Infra
- Memory is a TAM expansion market, says analyst: Micron's ceiling is investor belief, not fundamentals — BenBajarin · 2026-09-30
- Hyperscaler capex near $780B this year, yet only 30% of S&P 500 quantify AI impact — DavidGeorge83 · 2026-09-30
- AMD MI455 tipped at $28k per unit, but 432GB of HBM alone costs $12k-$14k — zephyr_z9 · 2026-09-30
- An Nvidia GPU depreciation slide that bears would rather not see — firstadopter · 2026-09-30
- a16z: hyperscaler capex hits $780B, AI adoption broad but shallow at just 2% real impact — a16z · 2026-09-30
- Peter Diamandis: civilizations are constrained by power, more energy means more possibility — PeterDiamandis · 2026-09-30