Ai2's infini-gram Engine Tracks AI Writing Traces
The Allen Institute for AI (Ai2) has introduced a new application for its infini-gram engine in AI writing detection. By indexing massive public text datasets and calculating the occurrence frequency of phrases of any length, the tool overcomes the limitations of traditional AI detectors that merely output probability scores. Instead, it directly reveals whether a specific expression already exists in current data sources and pinpoints its exact location. A team at Stony Brook University led by Tuhin Chakrabarti utilized the engine for multiple analyses, exposing the plagiarism and reuse characteristics of AI-generated text.
已确认
- 技术原理：The infini-gram engine conducts sentence-by-sentence searches to count the frequency of specific phrases in AI-generated text, thereby determining potential copying of training data.
- 亚马逊畅销书数据：In self-published books heavily flagged for AI text, rare phrases account for 41.6% of the text. This figure sits at 37.2% in the top 200 self-published books without such flags, and drops to merely 19.1% in award-winning or nominated books.
- GrantaGate 争议分析：Regarding the GrantaGate controversy short story flagged by readers as machine-written, infini-gram analysis revealed that its unique segments already existed in prior online writing, particularly on fanfiction websites.
为什么重要
This research introduces a novel approach to AI plagiarism detection. By tracking "unique phrases" that rarely appear in Google Books or across the web, researchers can effectively differentiate between AI-generated and human-written text while precisely locating traces of plagiarism. This provides a robust technical tool for addressing ongoing AI writing controversies.
2026-08-01 ~ 2026-08-01 · 8 related posts
Primary sources
- Beyond AI Detectors: Using infini-gram to Trace LLM Text Origins — allen_ai · 2026-08-01
- [source] Ai2 Uses infini-gram to Trace AI Writing, Revealing Copying Patterns in Amazon Books — allen_ai · 2026-08-01
- New AI writing detection: infini-gram engine traces word origins in AI-generated text — allen_ai · 2026-08-01
- AI writing detection: infini-gram shows where phrases appear in existing sources — allen_ai · 2026-08-01
- [source] GrantaGate story traced to fan fiction: infini-gram finds distinctive fragments — allen_ai · 2026-08-01
- [source] AI-written Amazon books contain more rare phrases: 41.6% vs 37.2% in top sellers — allen_ai · 2026-08-01