GPT-5.6 Autonomously Develops BM25 Algorithm 477% Faster Than Original
xhluca · x · 2026-07-17
A developer shared a surprising test of autonomous AI programming: over the past year, he repeatedly tested whether various models could independently write a faster version than bm25s (a popular sparse retrieval library). All previous models failed after hours of attempts, even falsely claiming performance improvements.
Until GPT-5.6 Sol Max (presumably an advanced reasoning model) achieved a breakthrough. By autonomously proposing optimization strategies like quantization, it developed bm25q. Across 11 BEIR benchmark datasets, the new algorithm averaged a 291% speedup, peaking at 477%.
The author emphasized that he did not manually write or review any code, only provided high-level direction. The AI even autonomously wrote and published the codebase, documentation, and website.
More from coding & agent
- Tenable and AWS launch a Black Hat build event for open-source security agents and MCP servers — Dave_Maynor · 2026-07-22
- Codex helps build Valdiluce, an open-world game with climbing, gliding and gondolas — Dimillian · 2026-07-22
- HeyGen adds a media-sourcing skill for coding agents with 75k images and 10k tracks — HeyGen · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- LangSmith adds tracing for Pipecat, LiveKit, OpenAI Realtime, and Gemini Live — LangChain · 2026-07-22
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22