Code Data Reshapes Model Workspaces
eliebakouch · x · 2026-07-19
This post shares new findings regarding jspace, focusing on version changes between @poolsideai's Laguna XS.2 and XS.2.1, and the optimizer's impact.
The core conclusion is that when fitted with code prompts, the workspaces of the two versions differ significantly. With wikitext prompts, they are generally similar, though structural similarities remain in the final layers, aligning with the "motor" sections mentioned in Anthropic's paper. The author believes the transition from XS.2 to XS.2.1 is likely driven by larger volumes of code data, significantly altering the model's internal representations.
More from Research
- Why a 1GW Chinese AI data center may be plausible after all — teortaxesTex · 2026-07-22
- LFM2.5-8B-A1B doubles its tokenizer vocab and cuts on-device decoding time up to 3.7x — maximelabonne · 2026-07-22
- Chinese AI labs are now treating distillation obfuscation as the top research topic — pmddomingos · 2026-07-22
- Structural ensembles beat single predictions in TCR:pMHC generalization study — quaidmorris · 2026-07-22
- RSS launches under OMSF to push structural biology data modeling at scale — MoAlQuraishi · 2026-07-22
- enFoldX tops 8 neoantigen scans and an unseen-peptide benchmark — quaidmorris · 2026-07-22