GPT-6 Sol plays rhythm games in real time, picking keys and tap times from frames

wzenus · x · 2026-10-17

In a rhythm game, Sol reads falling notes directly from video frames and chooses D/F/J/K keys plus literal tap times. Through autoresearch it learns to plan ahead using measured latency, cover newly visible notes before they become urgent, and keep note IDs stable to avoid duplicate taps. The GitHub repo includes a reproduction guide and autoresearch summaries; each game run records its timing, control boundary and failures.

Original post →

More from coding & agent

coding & agent channel →