Model repos should ship plotting code so new results can be compared cleanly
rishabh16_ · x · 2026-07-21
The author wants model repositories to include the matplotlib/seaborn code used to generate the paper’s figures. That would make it easier to drop in newer results and compare them against the original visuals instead of recreating plots from scratch.
They note that coding agents can partially solve the problem by recreating plots from a prompt, but argue that shipping the plotting code alongside the repo would still make apples-to-apples comparisons much easier for downstream work.
More from coding & agent
- Codex helps build Valdiluce, an open-world game with climbing, gliding and gondolas — Dimillian · 2026-07-22
- HeyGen adds a media-sourcing skill for coding agents with 75k images and 10k tracks — HeyGen · 2026-07-22
- Agent search bottlenecks are now about variance, not raw latency — rohanpaul_ai · 2026-07-22
- LangSmith adds tracing for Pipecat, LiveKit, OpenAI Realtime, and Gemini Live — LangChain · 2026-07-22
- An MCP server signs every AI agent tool call into a verifiable Merkle chain — Funky_Chicken_22 · 2026-07-22
- Annotated transcript of a Claude Code team interview is now available — trq212 · 2026-07-22