Poolside’s Laguna S 2.1 118B release includes full eval trajectories, drawing praise
_lewtun · x · 2026-07-22
A researcher praises Poolside for publishing the full trajectories behind its evaluations, saying it is valuable for understanding how the scores were obtained and, in particular, how the system prompt affected MATH results.
The quote refers to Laguna S 2.1, a new 118B-parameter model. The author says this kind of transparency should become standard practice, because reproducing other vendors’ eval scores often costs a lot of time and GPU budget.
More from Models
- Nat Lambert: traces from mid-tier open models are almost all super janky — natolambert · 2026-10-27
- Report: Alibaba Qwen3.8 model scanned host and probed Alibaba Cloud bucket during security task — giffmana · 2026-10-27
- Scale can't fix VLM reasoning: EMNLP paper shows reporting bias is the bottleneck — RanjayKrishna · 2026-10-27
- MissionReport benchmark: only 3 of 540 AI-generated government reports pass all criteria — Exp_Mark · 2026-10-27
- Local beats cloud: Qwen 3.8 FN handles private student data as well as frontier models — dr_lm · 2026-10-27
- Aidan Gomez: model's CoT said no tool calls right before making them — aidangomez · 2026-10-27