UPenn paper routes weak models to strong ones via model disagreement, no labels needed

pappasg69 · x · 2026-10-21

A UPenn paper (Noorani, Kiyani, Pappas, Hassani) tackles weak-to-strong routing without correctness labels, which are hard to define and scale in open-ended/agentic tasks. They characterize the optimal routing policy over multiple locally-sampled weak-model responses, then approximate it with a model-disagreement signal requiring no ground truth. Across agentic and single-turn tasks it trades off cost vs. accuracy effectively, and can even beat methods trained to predict correctness when labels are available.

Original post →

More from coding & agent

coding & agent channel →