PKU & Samsung: slow model coaching lifts fast agent's live game score from 13.51 to 24.19

rohanpaul_ai · x · 2026-10-17

A Peking University and Samsung paper shows game benchmarks that pause the world during inference massively overstate slow reasoning models: on RealtimeBench (180 tasks, 6 continuously running games), GPT-6.1-sol beat the faster Jev in 5 of 6 paused games but scored 1.51 vs 13.51 live.

Their fix, TORSI (Two-Timescale Offline Recursive Self-Improvement), has the slow teacher study the fast student's failures offline and write reusable instructions the student follows in real time. Two rounds raised Jev's average score from 13.51 to 24.19 across all six game types, and the instructions also improve three other models without retraining.

Takeaway for real-time agents: keep a fast model in the loop and use a slow model offline to write and validate its instructions.

Related event: RealtimeBench: Peking University and Samsung Benchmark Agents in a World That Won't Wait(2 posts)→

Original post →

More from coding & agent

coding & agent channel →