Chatting With Jev as a Regular LLM: A 3 tok/s Caveman-Style Experience
_rchaves_ · x · 2026-09-18
A user tried using TypeSafe's judgment model Jev as a regular chat model. Verdict: not a great idea — Jev generates at only 3 tok/s vs 150 tok/s for normal LLMs, has no caching so it ends up more expensive, and isn't RL'd for conversation. But he just wanted to talk to the model and learn how it "feels," even in caveman style, and finds it exciting to have a primitive that lets you kind of rebuild an LLM from scratch.
Related event: Dev Forces Judge Model Jev to Talk at 3 tok/s(3 posts)→
More from Fun
- America.gov's AI chatbot refuses a geography riddle — unless you ask about exactly 3 states — conitzer · 2026-11-02
- Letting Claude run wild in an endless loop, showing only what it thinks is cool — rachittshah · 2026-11-02
- Even a skeptic almost fell for an AI fruit cartoon reel — menhguin · 2026-11-02
- Sole Intentions: a film-noir style AI short film starring a sloth at an office desk — heresalexandria · 2026-11-02
- Founder Tries Building a Custom CRM, Ends Up Integrating 3 Existing Tools Instead — menhguin · 2026-11-02
- Designer calls out peer for near-verbatim copy of his Figma-to-Claude workflow thread — hewarsaber · 2026-11-02