Ai2's infini-gram Engine Tracks AI Plagiarism Traces
Ai2 introduced the infini-gram engine for AI writing detection, which indexes massive public text datasets to show the frequency and location of specific phrases. Stony Brook University's Tuhin Chakrabarty's team used this engine to reveal the plagiarism and reuse characteristics of AI-generated text.
Confirmed
- Technical Principle: The infini-gram engine can search and count the frequency of specific phrases in AI-generated text sentence by sentence, thereby determining whether it involves copying training data. By counting "unique phrases" that rarely appear in Google Books and the web, researchers can effectively distinguish AI-generated text from human writing.
- Amazon Bestseller Data: Rare phrases account for 41.6% of the text in self-published books detected with large amounts of AI text, compared to 37.2% in the top 200 self-published books not detected. In award-winning or nominated books, rare phrases only account for 19.1%.
- GrantaGate Controversy Analysis: Regarding the short story in the GrantaGate controversy flagged by readers as machine-written, infini-gram detection found that its unique segments appeared in existing online writings, especially on fan fiction websites.
Why it matters
This research proposes a new approach to AI writing plagiarism checking. By accurately locating plagiarism traces, it provides a powerful technical tool for resolving current AI writing controversies, visually demonstrating whether large language models are generating original content or verbatim regurgitating existing training corpus.
2026-08-01 ~ 2026-08-01 · 9 related posts
Primary sources
- New AI writing detection: infini-gram engine traces word origins in AI-generated text — allen_ai ·
- AI-written Amazon books contain more rare phrases: 41.6% vs 37.2% in top sellers — allen_ai ·
- AI writing detection: infini-gram finds distinctive phrases; GrantaGate story traced to fan fiction — allen_ai ·
- Beyond AI Detectors: Using infini-gram to Trace LLM Text Origins — allen_ai · 2026-08-01
- Ai2 Uses infini-gram to Trace AI Writing, Revealing Copying Patterns in Amazon Books — allen_ai · 2026-08-01
- [source] New AI writing detection: infini-gram engine traces word origins in AI-generated text — allen_ai · 2026-08-01
- AI writing detection: infini-gram shows where phrases appear in existing sources — allen_ai · 2026-08-01
- GrantaGate story traced to fan fiction: infini-gram finds distinctive fragments — allen_ai · 2026-08-01
- [source] AI-written Amazon books contain more rare phrases: 41.6% vs 37.2% in top sellers — allen_ai · 2026-08-01
- Dissecting LLM Regurgitation with the infini-gram Engine — TuhinChakr · 2026-08-01