Llama 3 8B with heavy sampling beats single-shot GPT-4o on competitive programming and formal math

agihouse_org · x · 2026-11-17

From Azalia Mirhoseini's lab, the 'Large Language Monkeys' paper shows Llama 3 8B, sampled many times, beats GPT-4o's single-attempt results on competitive programming and formal math proofs. The takeaway: test-time compute is the new scaling frontier — small models already know a lot, and test-time scaling draws it out.

Related event: Large Language Monkeys: Sampling Lets Llama 3 8B Beat GPT-4o(2 posts)→

Original post →

More from Models

Models channel →