Why Don't We Explicitly Use Gradients at Test-Time?

willdepue · x · 2026-08-02

Will DePue points out that gradients are a ridiculously powerful tool that we currently only use during training. He argues that it's crazy not to have any explicit gradients at test-time, which seems totally wrong.

Related event: LeCun Backs Inference-Time Optimization for Goal-Driven AI(4 posts)→

Original post →

More from Research

Research channel →