Hitchhiker's Guide to the AI Data Galaxy: 10 Key Terms from RL Environments to pass@1

geoffwolfe · x · 2026-10-11

With data companies attracting huge interest and LLM research jargon flying around, the author compiles a quick guide to 10 key terms in the AI data space:

RL environment: a practice gym where AI learns by doing—tasks, tools, and a score for every attempt.
Rollout: one complete attempt at a task, from first step to final answer.
Single-turn vs multi-turn: one question/one answer vs a whole conversation the model keeps track of.
Reasoning vs output tokens: scratch-paper thinking tokens vs answer tokens—you pay for both.
Harness: the spacesuit around the model—tools, memory and instructions that let it do real work.
Verifier: the tireless referee, code that checks every answer and assigns scores.
pass@1: how often the AI nails a task on its first try.

(The list is truncated in the original post; the full version covers the remaining terms.) A handy primer for decoding RL training and data-company discussions.

Original post →

Hitchhiker's Guide to the AI Data Galaxy: 10 Key Terms from RL Environments to pass@1

More from Models