AI audit identifies 97.7% real issues in math papers
littmath · x · 2026-08-27
The author shared a full report on using Refine.ink and ChatGPT to automatically review and create errata for 19 of their papers. The audit generated 266 detailed comments, 97.7% of which identified real issues (including 5 technical corrections to main results), with only 6 being incorrect. The author described some AI-generated errata as "slop" (mostly correct but overzealous) but hopes these tools can contribute to more reliable literature if used appropriately.
More from coding & agent
- Optimizing inference on 4090: sub-10ms latency achieved — yacineMTB · 2026-08-27
- Tutorial request: Bulk downloading songs with AI agents and auto-tagging — EnvironmentalTry8353 · 2026-08-27
- Google AI Studio enables two-way GitHub sync with direct commits and one-click deploy — jackwoth · 2026-08-27
- Opinion: Notification systems need rebuilding for agent-primary usage and context linking — andreisavu · 2026-08-27
- OpusClip and Beehiiv integrate to auto-turn videos into newsletters via Claude — azed_ai · 2026-08-27
- Bixbench3: Frontier Agents Score Below 50% in Reproducing Paper Analysis — xeophon · 2026-08-27