Opus 5 reportedly improvised a pseudo-vision stack on a blind FreeCAD eval
teortaxesTex · x · 2026-07-25
Opus 5 reportedly built its own pseudo-vision stack on a blind engineering task
A quoted eval says Claude Opus 5 was tested on a difficult benchmark task: reconstructing a machine part as a 3D FreeCAD model from an engineering drawing, while only seeing terminal text in a text-only mini-swe-agent harness.
- The model first tried standard OCR with Pillow and Tesseract.
- Thin numerals on the drawing were too unreliable, so it improvised a custom vision stack.
- The thread’s point is that the impressive part is not just the success, but that the model can assemble tools on the fly when deprived of direct vision.
A reply pushes back on framing this as Anthropic-specific, arguing that weaker blind models can also build ad hoc "pseudo-vision" from available tools; the real standout is still solving the multidisciplinary task.
Related event: Weak Vision Models Exposed for Faking Visual Abilities with Tools(2 posts)→
More from coding & agent
- DeepMind paper: LLMs can't sample randomly on their own, only convert given seeds — rohanpaul_ai · 2026-10-27
- DeepMind paper: LLMs can't sample randomly on their own — pass random numbers from code instead — rohanpaul_ai · 2026-10-27
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Two engineers rebuilt a FedEx supplier's billing core in 3.5 months vs an estimated 7-8 — alex_verem · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27