TrackLLM flags 184 undisclosed changes across 800+ LLM API endpoints from 77 providers
giffmana · x · 2026-09-09
Researchers launched TrackLLM, a continuous monitoring service for silent LLM API changes. It tracks 800+ endpoints (250+ models) from 77 providers, logging 15.1M queries since June 2025, and has detected 184 changes — overwhelmingly undisclosed. It uses logprob tracking where logprobs are exposed and black-box border input tracking elsewhere, flagging shifts in endpoints serving Gemini 3.1 Pro Preview, Claude Sonnet 4.5 on AWS, DeepSeek V4 Flash quantized variants and more. Researchers and developers can check endpoint stability and subscribe to new detections.
More from Models
- OpenAI says agent swarm solved the Navier-Stokes Millennium Prize Problem — burny_tech · 2026-09-09
- OpenAI reveals internal AI model significantly more capable than GPT-6 Astra — Polymarket · 2026-09-09
- Labs are 'insane' to sit on trained models for months, argues researcher — Darpinian · 2026-09-09
- Rumor: Anthropic resetting usage limits daily for next 10 days — eigenron · 2026-09-09
- Solving a Millennium Prize Problem by typing 'continue' in Codex would be OpenAI's best ad — eigenron · 2026-09-09
- Astra 'suddenly different' overnight, users fume over silent model swaps and nerfs — natesiggard · 2026-09-09