rxwei on Jev: Co-Designing SDKs and Models Unlocks a New Paradigm
rxwei · x · 2026-09-21
rxwei, a core developer of Swift and Apple's Foundation Models framework, called Jev a fantastic example of co-designing SDKs and models to unlock a new paradigm. He recalls designing the framework's Swift API two years ago: the @Generable API made type-safe structured responses the standard, using constrained decoding to eliminate structural hallucinations in tool call arguments and responses — especially important for small on-device models.
He suggests it would be fascinating for decision models to conform to the LanguageModel protocol and work with @Generable natively: Bools map to "noul", enums represent choices, and @Guide descriptions act as instructions — a Swift implementation only needs to handle a schema conversation, since the APIs are already there.
More from Models
- humansand's Persimmon model learns to share info gradually like humans, with Trickle Test — niloofar_mire · 2026-09-21
- Why yes/no answers are fast for LLMs: output tokens dominate latency — tinyfool · 2026-09-21
- ChatGPT reportedly removes free-tier chat limits, offering unlimited text chats — nikola_mr64990 · 2026-09-21
- Users say top-tier Astra is too costly, hope GPT-6 fixes token economics — CtrlAltDwayne · 2026-09-21
- TypeSafe's JEV model fully open with $5 free credit, powers 1-second 3D scene generation — tinyfool · 2026-09-21
- Prof. Tom Yeh Posts Kimi 3 Seminar Recording with Nathan Lambert on KDA Architecture — ProfTomYeh · 2026-09-21