Beyond AI Detectors: Using infini-gram to Trace LLM Text Origins
allen_ai · x · 2026-08-01
Traditional AI writing detectors only provide a likelihood score without showing whether specific expressions already exist in sources. Allen AI highlighted research by Tuhin Chakrabarti's group at Stony Brook using the infini-gram engine, which indexes massive public text datasets to count phrase occurrences.
The team applied this to books, filtering for rare phrases (appearing in 5 or fewer Google Books and unindexed on the web) to distinguish unique phrasing from clichés. They also analyzed the GrantaGate controversy, finding that text flagged as machine-written heavily matched existing content from fan fiction sites.
Related event: Ai2's infini-gram Engine Tracks AI Writing Traces(8 posts)→
More from Research
- LLMs Can't Jump: Research Highlights Lack of Abductive Reasoning for Scientific Invention — JoshuaJBouw · 2026-08-01
- Meta Releases AskChem: Turns 147K Chemistry Papers into 2.4M Searchable Claims — yuntiandeng · 2026-08-01
- New Breakthrough: AI Agents Tackle NMR Structure Elucidation — AllThingsApx · 2026-08-01
- How Synaptic Clustering Affects Learning: Computational Model Reveals Causal Mechanism — KordingLab · 2026-08-01
- New AI writing detection: infini-gram engine traces word origins in AI-generated text — allen_ai · 2026-08-01
- Implementing BatchNorm, LayerNorm, and GroupNorm from Scratch — jcflynnnn · 2026-08-01