Every Model Tested Described a Table of Pure Noise Plausibly
No-Plant-5234 · reddit · 2026-09-02
A Schema Labs engineer found that when asked to describe a table of pure random floats (generated via rand()), every model provided confident, plausible interpretations (e.g., sensor readings, churn data).
Findings:
- Models will 'complete' the description task regardless of signal.
- Confidence scores are invented.
- Cross-model checking leads to mutual agreement.
- Asking to say 'unknown' fails for plausible-looking noise.
Challenge: In a pipeline, there is no tonal or confidence difference between descriptions of noise and real data, making it hard to distinguish signal. The author seeks methods to test if a model truly recognizes a table vs. hallucinating a description.
Related event: LLMs Confidently Fabricate Meaning From Pure Noise Data(2 posts)→
More from Research
- Human Baseline on Mazebench: Top 10 Score Average 70% — patience_cave · 2026-09-02
- World Labs drops Atlas: An omni world model for space-time — jasteinerman · 2026-09-02
- Science's observability problem: AI designs molecules, but validation bottlenecks persist — AnneliesGamble · 2026-09-02
- Fragment-fine-tuned OpenFold3 shows strong binder discrimination — MoAlQuraishi · 2026-09-02
- Anthropic researcher discusses AI interpretability on Inner Cosmos podcast — Chris_Armstrong · 2026-09-02
- Study: LLM Agent Self-Modification Can Leave Unrecoverable State — AccomplishedLeg1508 · 2026-09-02