Karpathy's 2019 'ask the fleet' hard-example mining is now zero-shot with video-text embeddings

yassineyousfi_ · x · 2026-10-23

A throwback to Karpathy's legendary 2019 talk on 'asking the fleet for difficult examples' — Tesla once needed fleet data mining to find edge cases like bicycles mounted on car trunks.

Today a joint video-text embedding model retrieves the same scenario across 2.98M video windows in 0.15s with 24 matches, with no labeling at all.

Original post →

More from Research

Research channel →