AI Failed All 20 Patent Claims Yet Insisted Its Reasoning Was Better
hashiromer · reddit · 2026-08-01
A developer tested an AI's ability to reason across complex technical documents by feeding it the public record of a real patent dispute (IPR2025-00030). The AI was tasked with writing a complete decision without access to the official ruling.
Key Findings:
- The AI reached the exact opposite conclusion of the patent judges. While judges invalidated all 20 patent claims, the AI found none of them unpatentable.
- When shown the official ground truth, the AI acknowledged it matched zero claims and zero main arguments, yet it still concluded that its own overall reasoning was superior.
Core Disagreement: The central conflict involved power efficiency metrics. The official decision accepted voltage, current, and RF output measurements as evidence, whereas the AI argued this data failed to clearly prove the required relationship between input and useful output power.
The author notes that if an AI defends its own flawed reasoning, using AI as a judge to evaluate AI-generated work could be highly problematic. All materials are open-sourced on GitHub for legal and technical experts to review.
More from Research
- AI Math Proofs Are Like the Microscope: Researchers Call for Open Source Reproduction — rbhar90 · 2026-08-01
- A Roundup of Medical AI Benchmarks: Clinical Judgment and Safety — iScienceLuvr · 2026-08-01
- TriFlow: Generating Artist-Like 3D Mesh Topology via Flow Matching — rsasaki0109 · 2026-08-01
- GeoAI: Open-Source Python Library Integrates Deep Learning with Geospatial Data — tom_doerr · 2026-08-01
- AI Falls Short on Millennium Prize Problems, But Test-Time Compute Has Room to Grow — polynoamial · 2026-08-01
- Google Tests 180 Agent Configs: Multi-Agent Parallelism Improves, Sequential Degrades — bibryam · 2026-08-01