Agent RL for three models cost $1,177 total; LFM3 gained 43% tool efficiency

yb2698 · x · 2026-11-09

Key metrics on a 150-task held-out test set: all models showed tool efficiency gains, up to 43% for LFM3. Except for TwIL-8B pi and the LFM3 models, accuracy changes stayed within noise — likely because the set is still too easy for bigger models, though the signal is clear for LFM3. On the small (40-task) traj2env held-out set, most models were also within noise.

Total cost of the three training jobs on HF Jobs was about $1,177: LFM2.5 ran 36h for $720, TwIL-8B 13.5h for $271, LFM3 18.6h for $186. Sandbox costs excluded; cpu-basic sandbox instances run $0.01/hour.

Original post →

More from coding & agent

coding & agent channel →