AtomWorld: LLMs Struggle with Atomic Operations
新智元 · wechat · 2026-07-14
This article introduces AtomWorld, a new materials science benchmark designed to evaluate large models on "atomic-level spatial operations" rather than just text comprehension.
Key conclusions include:
- While LLMs excel at reading literature and summarizing material knowledge, they hit significant bottlenecks in real-world 3D atomic operation tasks.
- Relying solely on the Scaling Law (expanding parameters and data) helps with clearly defined operations, but yields inconsistent improvements for spatially dependent tasks like rotation, region deletion, and supercell expansion.
- The research team argues that AI for Science must move beyond Language Scaling to embrace Action Scaling focused on execution and feedback.
AtomWorld's evaluation pipeline auto-generates "structure-text" paired samples and uses structure matching tools to compare model outputs against ground truths, quantifying whether the model correctly altered the atomic arrangement per instructions. The article notes that while external tools can help output precise coordinates, they cannot replace the model's own decision-making regarding where atoms belong or which atoms form the target region.
The author broadens this issue to general scientific agents: in fields like materials modeling, molecular design, and automated experiments, AI must reliably execute actions, not just interpret knowledge, to truly participate in scientific research.
More from Apps
- Photoshop finally lets users clean up the Save As format list — rufusd · 2026-09-11
- Build X Carousel Posts from One Wide Image: A Splitter Tool Plus YouMind Skill Workflow — sujingshen · 2026-09-11
- Ant's Afu health AI hits 150M users, unveils AI+hardware health alliance at Bund Summit — APPSO · 2026-09-11
- Reverse prompting: let the AI interview you with 5 questions for sharper output — thisdudelikesAI · 2026-09-11
- Prompting tip: add constraints to role prompts, that's what makes them useful — thisdudelikesAI · 2026-09-11
- AI sales agents shine at the top of funnel but lose real deals, says GTM practitioner — gogeta7124 · 2026-09-11