Astra still generates fake unrelated criticisms when fact-checking, user finds

AndyMasley · x · 2026-09-07

Andy Masley had Astra fact-check something he wrote and found it still does what all LLMs do: come up with fake unrelated criticisms — e.g., disputing "data centers didn't add water pollution here" by arguing water pollution "can definitely still be a problem in general." Even frontier models struggle to respect the boundary of a specific claim in fact-checking tasks.

Original post →

Astra still generates fake unrelated criticisms when fact-checking, user finds

More from Models