Inserting probes alters compiled Qwen3 logits, sparking debate

Sauers argues that probes altering compiled Qwen3 logits is documented compiler DAG behavior, not a bug. The discussion also covers models being trainable to detect probed environments, and confusion over TransformerLens showing run-to-run nondeterminism without probe-induced activation changes.

2026-10-19 ~ 2026-10-19 · 3 related posts