Vite core member finds methodology flaws inflating oj's memory benchmarks by 100MB+
cnakazawa · x · 2026-09-25
Vite core team member sapphi-red filed an issue on lovablelabs/oj exposing methodology problems in its README memory benchmarks:
- Only the parent process is measured: the script uses ps -o rss= -p $PID, missing oj's separate Node process — roughly 110MB uncounted at 1k components, 150MB at 10k on their machine.
- Measured before GC: forcing GC before measuring cut Vite's reported memory by 30%.
- RSS alone misleads: mimalloc (Rolldown's allocator) retains fragmented pages after dependency optimization, keeping RSS artificially high.
Commenters note such flat-out-wrong details still get massive reach — "massive slop." Findings may feed back into Vite and Rolldown.
More from coding & agent
- Prompt boxes are dying, and embedded app agents still lose to agents driving human tools — andpoul · 2026-09-25
- Agents inside apps vs. operating human tools: a short debate — andpoul · 2026-09-25
- Devin launches a redesigned home page for its AI coding agent — DevinAI · 2026-09-25
- Blender agent skill turns concept art into rigged game assets — one user shipped a Mario 64-style game in 8 hours — majidmanzarpour · 2026-09-25
- Designer argues agent-native pro tools, not prompt boxes, are the future of AI work — bartonsmith · 2026-09-25
- Open Manager for ComfyUI adds desktop mode for Vast.ai and other cloud GPU services — WASasquatch · 2026-09-25