NLA Maintains Accuracy but Confabulates More
Turn_Trout · x · 2026-07-13
The author proposes an explanation: Claude's guesses might leak some "real stuff," such as the identity of the last token; these rare clues are particularly critical for reconstruction tasks.
The thread also mentions a key finding: an NLA initialized with confabulation achieves almost the same reconstruction accuracy as the control group, but massively increases the confabulation rate, reaching 99.3%. In other words, training can reduce confabulation to some extent, but it's not enough to offset the bias introduced by this initialization; meanwhile, the control group actually learns to confabulate more.
More from Research
- Eric Topol challenges frontier-model study: where's proof of sustained upskilling? — EricTopol · 2026-10-27
- New paper: LLM data schedules and learning rate schedules should be co-designed — jasondeanlee · 2026-10-27
- What makes research get adopted: important problems, proper evals, and usability — srchvrs · 2026-10-27
- Bitter lesson part 2: few academic inventions matter, and conference publications aren't the key — srchvrs · 2026-10-27
- First-week PhD student lands ARR Area Chair role, exposing peer-review quirks — anmarasovic · 2026-10-27
- EMNLP keynote: industry does read academic NLP papers, it just rarely credits them — srchvrs · 2026-10-27