HAPAX Training Shows Abstract In-Context Learning Emerges Without Induction Copying

A Northeastern team led by David Bau presents HAPAX (EMNLP 2026 Main), a training method that removes induction copying, showing that abstract in-context learning still emerges and challenging the assumption that induction heads underlie all ICL.

2026-10-26 ~ 2026-10-26 · 2 related posts

• HAPAX paper: abstractive ICL emerges even without induction-head copying — davidbau · 2026-10-26

1 near-duplicate retellings: davidbau