claude-video: Giving Claude the Ability to Watch Videos
aigclink · x · 2026-07-07
claude-video is a skill where a user provides a YouTube/X/TikTok/local link along with a question. It automatically downloads the video using yt-dlp, extracts frames with ffmpeg, and prioritizes free subtitles (falling back to Whisper for transcription if unavailable). It then feeds the timestamped frames and text to Claude's multimodal capabilities, allowing the model to actually "watch" the visuals and "listen" to the audio before answering. The core engineering challenge is the high cost of image tokens, which the author tackles as a "frame budget" problem, offering a four-tier detail comparison. This approach contrasts with video-use, where the LLM reads only text without actually watching the video.
Related event: Open-Source Tool claude-video Enables Video Understanding(2 posts)→
More from coding & agent
- BELL: Open-Source Stack Combines Browserbase, Eve, iMessage and Stripe Link for Personal Agents — jeff_weinstein · 2026-10-27
- Legora runs 2,000 parallel agent evals on Modal Sandboxes for legal AI — blelbach · 2026-10-27
- Two engineers rebuilt a FedEx supplier's billing core in 3.5 months vs an estimated 7-8 — alex_verem · 2026-10-27
- GPT-6.1 Terra gains ~20 points on Terminal-Bench 4.0, rivalling GPT-6.1 Sol — ArtificialAnlys · 2026-10-27
- GPT-6.1 Terra scores 48 on AA Coding Agent Index at one-third the cost of GPT-5.6 Terra — ArtificialAnlys · 2026-10-27
- Shift-1 router cuts coding agent spend up to 55% while keeping SWE-bench accuracy — ypatil125 · 2026-10-27