Google-led T2J-Bench and TwinHarness lift PyTorch-to-JAX migration reward 11.4% across 63 repo tasks

jiqizhixin · x · 2026-11-16

Researchers from Google Cloud AI Research, UIUC, USC, Notre Dame and Google DeepMind introduce T2J-Bench and TwinHarness (arXiv paper) to verify PyTorch-to-JAX migrations.

The problem: a rewritten model can run successfully while silently changing gradients, optimization trajectories, or inference-cache behavior — and a JAX interface can even hide leftover PyTorch dependencies.

How TwinHarness works:

Results: with Claude Code and opus-5 held fixed, mean migration reward rises from 0.649 to 0.723 across 63 repository tasks and three seeds — an 11.4% relative improvement.

Original post →

More from coding & agent

coding & agent channel →