ECHO-style SFT losses in RL dodge the elicitation-only criticism, researcher argues

stochasticchasm · x · 2026-11-23

In a discussion with YouJiacheng, stochasticchasm argues that supervised post-training losses like ECHO used during RL don't share the common "elicitation-only" criticism aimed at RL — that RL merely elicits capabilities already in the base model rather than teaching new ones. He also floats open questions about post-training older base models and whether a model with higher log-perplexity would still be good at tasks like cyber. A niche technical exchange on training methodology.

Original post →

More from Research

Research channel →