NLA Keeps Accuracy but Fabricates More

Turn_Trout · x · 2026-07-13

Experimental results show that an NLA initialized with confabulation has almost the same reconstruction accuracy as the control group, but its outputs contain a massive amount of fabricated content, reaching a high of 99.3%.

More notably, the training process does reduce its fabrication rate slightly, but not by a wide enough margin; it ultimately remains more prone to fabrication than the control group. Conversely, the control group actually learns to fabricate more after training.

Related event: Probing NLAs: False Initialization Maintains Accuracy but Increases Confabulation(7 posts)→

Original post →

More from Research

Research channel →