SemIf: semantic 'if' decisions with local open models, entirely in your browser
ngxson · x · 2026-09-19
SemIf on openjev.com is a live, backend-free experiment in semantic conditionals: an open model reads probability distributions over your allowed options without decoding them, or writes the same distribution token by token, so you can compare both on your own GPU.
Model choices: Qwen3 0.6B (639 MB, phones), MiniCPM5 2B (1.56 GB, desktop), Qwen3.5 4B (3.01 GB). Authored balanced accuracy: 44% / 68.6% / 81.3%; TypeSafe agreement on a public 102-row subset: 40.7% / 63.7% / 84.5%, vs. a published Jev value of 88.3%. Weights cache in-browser from Hugging Face and inputs never leave the page.
Related event: wllama V3 and openjev bring local LLMs to the browser(3 posts)→
More from Infra
- AMD's Mi355X Beats Nvidia GPUs on Per-Gigawatt Margins Running Kimi K3, SemiAnalysis Finds — m2saxon · 2026-09-19
- Dev builds daily-driver AI coding environment on AWS Lambda MicroVMs with S3 persistence — blaizedsouza · 2026-09-19
- Running 35B–284B MoEs at 128k Context on a 12GB A2000: Measured, Plus What Didn't Matter — HomoAgens1 · 2026-09-19
- Joseph Suarez hits SOTA in 5 hours on consumer cards in a warehouse — yacineMTB · 2026-09-19
- MiMo RL livestream: infra restarts waste 33% of compute, over $400K lost — dustinvtran · 2026-09-19
- Why Jev-class models could become a near-free judgment primitive running on-device — signulll · 2026-09-19