TypeSafe Jev uses next-token probabilities for snap judgments — why frontier labs could clone it easily
JnBrymn · x · 2026-09-18
JnBrymn analyzes what products like TypeSafe Jev actually do: instead of iteratively generating text, they use an LLM to look only at the next-token probabilities of a fixed option set (e.g. satisfied: 1%, dissatisfied: 99%) and answer from those. Since the architecture is nearly identical to a normal LLM, OpenAI or Anthropic could clone it by swapping in a fine-tuned output head — and frontier labs could go further, running a quick-decision head and conventional generation concurrently on the same GPU during a reasoning trace, giving models instant snap-judgment abilities. The big unknown is Jev's "Reinforcement Learning for Calibrated Decisions": coaxing realistic calibrated probabilities out of past events that either happened or didn't may be the actual moat. Likely partly an in-joke product, but the logprob-classification discussion is substantive.
More from Models
- Musk cites unsustainable Grok Bot costs as Hermes offers one-command agent migration — Teknium · 2026-11-04
- Hobbyist rewrites Qwen 0.6B weights with 39.8M tokens, no gradients, in 3h12m — Altruistic_Heat_9531 · 2026-11-04
- Same leak, reshared: ChatGPT's five family plan prices spotted again — heyshrutimishra · 2026-11-04
- KOL visits StepFun's Shanghai office, hints a powerful new model is coming — teortaxesTex · 2026-11-04
- Fable 5.5 delayed as Anthropic reportedly bets OpenAI's Astra 6.2 won't beat it — haider1 · 2026-11-04
- ByteDance open-sources Axion 1.0-35B agent foundation model with full reproducible recipe — pmttyji · 2026-11-04