Fine-tuning is mostly iteration: cleaning data beats tuning hyperparameters
ziv_ravid · x · 2026-11-20
Ziv Ravid's thread (posts 8-9): from there it's mostly iterations — train, look at where the model fails on the eval, figure out which kinds of traces are missing or noisy, fix, and repeat. Cleaning the data usually helps more than playing with hyperparameters, though it depends on the problem.
More from coding & agent
- Dusk bot: open-source Grok Bot alternative reuses your ChatGPT/Claude/Grok subscriptions, 476 GitHub stars — EXM7777 · 2026-11-20
- Theo's Restaurant Analogy Nails Agentic UX: The Whole Kitchen Waits on Your Fries Decision — seatedro · 2026-11-20
- An Interactive Cat's-Eye World in a Single HTML File — No Images, Models, or Libraries — NathanWilbanks_ · 2026-11-20
- Multi-agent RL recipe turns pass@k into pass@1 on hard chess puzzles — shizhediao · 2026-11-20
- Steering a Local LLM's Attention Directly: Sliders That Shift Activations, Not Prompts — round · 2026-11-20
- Railway launches Cloud Agent Tasks: machine, conversation and result are separate — reusing a VM doesn't mean memory — krishnan · 2026-11-20