Dev reality check: hours babysitting frontier model errors vs X hype of superhuman AI

mervenoyann · x · 2026-09-13

A reply describing the daily reality of working with frontier models: N hours spent babysitting them in frustration at frequent errors and slop, interrupted by M-minute breaks browsing X posts claiming the same models — especially the next generation — are superhuman at everything. Another researcher (@mervenoyann) says she has the same experience, highlighting the gap between hands-on use and online hype.

Related event: Frontline practitioners say frontier models still need daily babysitting, far from the "superhuman" hype(5 posts)→

Original post →

More from Models

• ARC Prize 2026 closes in 3 days as Yi-Chia Chen tops ARC-AGI-3 at 75.56% — GregKamradt · 2026-10-31
• Fable 5.5 Max stuns with gorgeous SVG of a pelican riding a bicycle, headed to Claude Code — ChrisGPT · 2026-10-31
• OpenAI reportedly to train on users' Daybreak sessions with no opt-out — dyn___ · 2026-10-31
• NVIDIA Nemotron 3.5 scales LLM self-verification, +9-10 points on agentic benchmarks — sarahcat21 · 2026-10-31
• Mistral Large 4 scores 94% on 1,273 USMLE-style questions but flips 44 at temp 0 — MaziyarPanahi · 2026-10-31
• Researchers find 5 personality structures in LLM weight space, Big Five-like — luke_drago_ · 2026-10-31

Models channel →