Fewer Prompts Alter jspace Shape
eliebakouch · x · 2026-07-18
While estimating jspace, the author mentioned using only 250 prompts this time due to the larger model size, compared to the 1000 prompts used in previous neuronpedia checkpoints.
They also shared previous experiments on Gemma 3-27B demonstrating that prompt quantity affects the shape of jspace. Key takeaways include:
- Estimation scale is constrained by model size
- The number of sampled prompts changes the resulting shape
- This phenomenon was already observed in prior Gemma 3-27B experiments
Related event: MoE Experiments Reveal Prompt Quantity Impacts Jspace Estimation(2 posts)→
More from Research
- Could 10k agents discover learning methods beyond backprop, or just tweak existing ones? — SeunghyunSEO7 · 2026-09-11
- TRACES grades the process, not the answer: six-dimension eval for open-ended AI science — Faheem_uh · 2026-09-11
- Apodex launches TRACES, a benchmark grading AI on open-ended discovery instead of known answers — Faheem_uh · 2026-09-11
- Cognition's SWE-2 uses a KKT duality argument in RL to shift the effort Pareto curve — YouJiacheng · 2026-09-11
- VidMap uses RoMa coarse matching on all frames, fine-scale only for keyframes — ducha_aiki · 2026-09-11
- Bug Hunt Bench author: leaderboard noise is about 2-3 points — PawelHuryn · 2026-09-11