Barbell-tracking app built on custom physics engine: LLMs compute forces in 3 steps

wordgrammer · x · 2026-11-17

wordgrammer's team shipped a 3D/VFX/physics engine (Fable 5.2) three weeks ago, but VFX was never the goal — they wanted a barbell-tracking app, and building a physics engine was a prerequisite. They use "physics" for actual physics: language models compute forces, movement, and 3D positions of barbells.

The core workflow: (1) run segmentation models to identify the weight's shape; (2) use coding agents to identify exact plate models, pull dimensions from manufacturer sites, and construct a 3D model; (3) run 15,000 simulations in parallel to find the best match between segmentation and the 3D model. The whole pipeline takes about an hour.

Original post →

More from coding & agent

coding & agent channel →