Dhruv Batra: screen-reading web agents can handle changing websites without APIs
Responsible-Grass452 · reddit · 2026-09-16
Dhruv Batra explains how web agents can rely on visual information from the browser instead of fixed APIs or hard-coded site structures: the agents look at screen pixels, take actions, and keep learning from interactions with live websites. When layouts change, they adapt from new data rather than needing manual reprogramming.
He adds that on poorly designed websites, the agents can sometimes navigate the interface better than he can.
More from coding & agent
- E2B Renames Its Open-Source Project to E2B Runtime, the Backend Behind Its AI Agent Cloud — badphilosopher · 2026-09-16
- Coding Agents Are Making Hypothesis Testing Cool Again in NLP Papers, Reviewer Observes — deliprao · 2026-09-16
- Dev tip: Tailscale plus Android wireless debugging is all you need — haydendevs · 2026-09-16
- ApprenticeBench: best human testers pass only 51% first-try — agents don't need perfection — hhsun1 · 2026-09-16
- God's Eye View surges on GitHub trending as community piles on new layers — bilawalsidhu · 2026-09-16
- Inspo MCP hits 1k installs; creator open-sources the Remotion launch video too — rohanpaul_ai · 2026-09-16