How models fake determinants: a 3x3 trick that dies at 4x4 and a sign-counting hack
scaling01 · x · 2026-09-27
A deep-dive (summarized by Opus) into how models Astra, Sol and Fable compute determinants: Astra's edge comes from two learned tricks with sharp limits, not a general algorithm.
- The 3×3 trick: Astra nails 3×3 determinants in one step (100% with entries up to ±5) where Sol and Fable score 0. But it's narrowly specialized: accuracy drops to 50% at entries around ±25, near 0 at ±99; dense 4×4s fail even with tiny entries (≤25%); and it only works on a 3×3 hidden in a larger matrix if the block sits isolated in a sparse matrix of size 6+.
- The sign trick: Astra gets the sign right by counting minus signs — perfect while the rarer sign appears ≤16 times, even in 512-number lists or 64×64 matrices, breaking around 30. Length itself doesn't hurt; dense negative packing does. Sol and Fable lose the sign after 2–3 negatives, and Fable just guesses 'negative' when it sees many minus signs.
This informs ongoing probing: fixing the count of -1s while varying matrix size n would hint at what algorithm, if any, the model implements.
More from Models
- Leaked Anthropic remarks: Opus 5.5 cost over $10B, AI market is "winner take all" — A_K_Nain · 2026-11-11
- ChatGPT users hit mass "could not load conversation" errors across devices while status page stays green — CleanSignalLab · 2026-11-11
- Anthropic engineer's Fable 5.2 one-shot 'AAA-level' game sparks AI-renaissance debate — RileyRalmuto · 2026-11-11
- Age-verified paying user calls out ChatGPT for still blocking consensual adult fiction — Scary_Fix_1295 · 2026-11-11
- User reports hitting usage limits after just ~15 messages on flash-lite — Weird-names · 2026-11-11
- Developer fights Claude's "clever" phrasing; standing instructions keep drifting — jkubicki · 2026-11-11