How to Control LLM Reasoning Effort
Ahead of AI (Sebastian Raschka) · rss · 2026-07-18
This article explores how to control an LLM's reasoning effort, reviewing the basic concepts of reasoning models before discussing scaling approaches at both the training and inference levels.
Core Concepts
- A reasoning model doesn't equal human reasoning; it's a model that outputs intermediate reasoning traces and solves problems step-by-step.
- There are two main paths to improving reasoning: training scaling and inference-time scaling.
Training Level
- The article highlights RLVR (reinforcement learning with verifiable rewards): using outcome correctness as a reward for verifiable tasks.
- Verifiable domains are primarily math and coding, using tools like symbolic calculators, compilers, and unit tests to verify correctness.
- Training doesn't truly depend on the intermediate reasoning traces themselves; rewards are based mainly on the final answer and format.
- Driven solely by output rewards, models can learn to self-correct, backtrack, and revise—phenomena dubbed "Aha" moments.
Inference Level
- Extra compute can be applied during inference to improve answer quality, known as inference scaling.
- An example is self-consistency: sampling the same prompt multiple times and using majority voting to select the final answer.
- This method works for standard LLMs and can be layered on top of reasoning models.
Further Discussion
- The article notes that many modern LLMs have, in a sense, already become reasoning models.
- It introduces the concept of "different effort levels," allowing models to trade off speed, cost, and performance by controlling reasoning intensity.
More from Research
- New paper: Absolute pose estimation from affine cues and gravity direction — ducha_aiki · 2026-09-11
- LoMa Paper Ships REALLY HardPairs Dataset, Accepted at ECCV 2026 — ducha_aiki · 2026-09-11
- Johns Hopkins Launches Full-Stack Hands-on Robot Learning Class with SO-101 Arm Kits — _krishna_murthy · 2026-09-11
- SyncWorld: In-Context Robot World Model Simulates Unseen Views and Embodiments Zero-Shot — ChongZzZhang · 2026-09-11
- A 3D Pose Dataset for Dogs Released — ducha_aiki · 2026-09-11
- Five tells that still make AI video read as AI, from physics glitches to missing operators — NewPhoneWhotiz · 2026-09-11