MIT's PDDL-INSTRUCT Boosts Llama-3-8B Planning Accuracy from 28% to 94%
mdancho84 · x · 2026-09-25
MIT researchers propose PDDL-INSTRUCT, claiming it teaches LLMs genuine logical reasoning and planning rather than pattern matching.
- Training: fine-tune on correct and incorrect plans with explanations.
- External verification: an outside verification process checks each step of the LLM's reasoning for soundness.
On their planning benchmarks, Llama-3-8B jumped from 28% to 94% accuracy — a step-change rather than incremental gain. This is a third-party thread summarizing the paper; details warrant verification.
More from Research
- TorchCurves: Differentiable Learnable Parametric Curves for PyTorch — Alex Shtoff · 2026-11-11
- AI-assisted proof shows no voting rule beats Borda on strategyproofness — conitzer · 2026-11-11
- Markowitz mean-variance portfolio theory applied to mixing MCMC samplers — michaelchchoi · 2026-11-11
- AI agents run 24/7 for a month to rewrite Météo-France's AROME weather model — IgorCarron · 2026-11-11
- NYU's Steertuning Lets a Robot Learn a Chore From 5 Minutes of Human Demo — CyberRobooo · 2026-11-11
- New preprint maps human embryonic patterning in early organogenesis at spatial single-cell resolution — anshulkundaje · 2026-11-11