Yoav Goldberg warns server-side session APIs from Anthropic/OpenAI will obscure the model
yoavgo · x · 2026-11-19
AI researcher Yoav Goldberg highlights an overlooked dimension of "openness in AI": API openness.
- Traditional LLM APIs mapped straightforwardly to what was actually sent to the model — a sequence of role-tagged messages fully specified by the caller, giving both transparency and control.
- Anthropic and OpenAI are transitioning to new APIs where session state is managed server-side; he predicts the old stateless APIs will eventually be deprecated.
- That adds an opaque layer between users and "the AI" (no longer just an LLM), sharply reducing visibility and intervention points — making research on agentic harnesses and context management practically impossible.
- He argues this matters as much as open-weight models, maybe more, and asks how the community should organize resistance.
Related event: Yoav Goldberg Warns Hosted-Session APIs Will Turn LLMs Into Black Boxes(2 posts)→
More from AGI Musings
- Stanford professor: AI takes students from problem to working prototype in 80 minutes — HariSubramonyam · 2026-11-19
- Berggruet Winner Thomas Nagel Dismisses AI Consciousness Talk as 'Just Ridiculous' — Dr_Atoosa · 2026-11-19
- Dwarkesh Claims China Is Only 12 Hours — Not 12 Months — Behind Frontier AI Labs — teortaxesTex · 2026-11-19
- Researcher calls METR/Anthropic '2x speedup' RSI analysis statistically dubious — jessi_cata · 2026-11-19
- Physician: AI competition now measured in weeks, GPT-6 versions 7 days apart — ramos_casals · 2026-11-19
- Why pro-handover rhetoric fails: people don't trust ASI's loyalty to labs — 1a3orn · 2026-11-19