Six Months of AI Auto-Research Tools, But No Clear Acceleration in Algorithmic Efficiency
soumitrashukla9 · x · 2026-08-12
User @testingham points out a thought-provoking observation: despite having workable AI autoresearch tools for about six months, we aren't seeing a notable acceleration in progress in algorithmic efficiency, at least judging by public leaderboards.
He shared his "vibeslop analysis" and open-sourced a supporting GitHub dataset (ai-discovery-data). The project aims to track rates of discovery over time across various domains, such as vulnerability disclosures, mathematics, and algorithms, to empirically measure whether there has been a recent acceleration in scientific discovery driven by AI.
More from Research
- Cornell Paper: Encrypting Chain-of-Thought Fails to Prevent Model Distillation — burkov · 2026-08-12
- Raspberry Pi Runs Robot Path Planning Algorithm, Covering Campus in 19s — 4310sy · 2026-08-12
- NBER Paper: GenAI Faces Oligopoly, Open Ecosystems Need a 'Rogue' Giant — soumitrashukla9 · 2026-08-12
- SiPE: Integrating Syntax Priors into Transformer Positional Embeddings — UArizona · 2026-08-12
- Study Finds: Higher Reasoning Effort Makes LLMs Less Likely to Ask Clarifying Questions — xuanalogue · 2026-08-12
- Open Dataset Measures AI's Actual Impact on Accelerating Scientific Discovery — soumitrashukla9 · 2026-08-12