Training NLA with Entirely False Explanations

Turn_Trout · x · 2026-07-13

Discussing an experimental setup for NLA: Claude is first asked to generate confabulations where "every sentence must be false," and these fabricated explanations are then used to train the NLA to observe changes in reconstruction accuracy and output behavior.

The core question is: if the model's initial explanations are systematically wrong, can the trained NLA still maintain decent reconstruction accuracy, and will it ultimately continue to fabricate heavily or gradually revert to outputs that look more like "reasonable explanations"?

Related event: Probing NLAs: False Initialization Maintains Accuracy but Increases Confabulation(7 posts)→

Original post →

More from Research

Research channel →