FLEET gives Best-of-N sampling memory via MCTS, hits GSM8K baseline with half the iterations
Helpful_Minimum_2214 · reddit · 2026-10-02
The authors of FLEET propose attributing external rewards to specific tokens, storing high-entropy states in a vector store with reward histories, and using a modified MCTS to adjust logits on the next run. On Llama 3.2 3B it matched the sampling baseline on GSM8K with half the iterations and lifted LiveCodeBench v6 easy from 0.59 to 0.69 under the same budget (9 vs 32 iterations). The method runs without sequential execution and the metadata store can serve as a prior for other tasks or SFT/RL. Paper and code are open.
More from Research
- SAIL 2027 opens abstract submissions for AI in clinical care, deadline Jan 15 — zakkohane · 2026-11-19
- The academia LLM paradox: everyone writes with AI, nobody wants to read or be judged by it — wandedob · 2026-11-19
- Baseten hosts All-Gather, its first research conference on where AI's next gains will come from — baseten · 2026-11-19
- Interpretability solved—then what? Najoung Kim proposes filtering for recurrent constructs — najoungkim · 2026-11-19
- New preprint asks: if interpretability is "solved," what does it mean for the science of human language? — najoungkim · 2026-11-19
- Map of tabular foundation models shows only two are fully open — GaelVaroquaux · 2026-11-19