Researchers debate whether LLMs need token-for-token conditioning to generalize
srush_nlp · x · 2026-07-23
A discussion about whether token-for-token conditioning is really necessary in LLM training.
One side says the harness argument is plausible, but token-level conditioning seems unlikely to be the whole story because LLMs already show strong input generalization beyond exact training patterns.
Related event: LLM Generalization Debate: Intrinsic Model or Harness Contribution?(11 posts)→
More from Research
- rauchg reproduces OpenAI's covert CPU-channel finding: chat across Firecracker microVMs with no network — ccerrato147 · 2026-10-27
- Microsoft Research: ForkPilot cuts long-horizon agent compute by up to 59% — EliasEskin · 2026-10-27
- Microsoft's TeleTune evolves agent skills from offline user telemetry — EliasEskin · 2026-10-27
- FlexGlue: sparse-to-dense matching that beats dense accuracy at a fraction of the cost — zhenjun_zhao · 2026-10-27
- PixGR: pixel-space generative decoding for fast feed-forward 3D Gaussian reconstruction — zhenjun_zhao · 2026-10-27
- Mundo turns a few room photos into an explorable, simulatable 3D world — at 1.5 FPS — mark_k · 2026-10-27