10 open-source GitHub repos that give your AI agent the whole internet
victor_explore · x · 2026-10-25
A curated compilation of 10 open-source repos that equip AI agents with web access, with star counts checked Oct 2026:
- Firecrawl (18.6k★): search, scrape and interact with any site
- Browser Use (11.7k★): a real browser your agent can drive
- Crawl4AI (8.4k★): turns any website into LLM-ready markdown
- Scrapling (8.4k★): adaptive scraper that survives layout changes
- MarkItDown (18.8k★, Microsoft): PDFs and Office docs into markdown
- Chrome DevTools MCP (5.5k★): Chrome DevTools control for coding agents
- agent-browser (4.3k★, Vercel Labs): Rust-based browser automation CLI
- Playwright MCP (3.8k★, Microsoft): Playwright as an MCP server
- Lightpanda (3.6k★): headless browser built for AI
- SearXNG (3.8k★): self-hosted, private meta search engine
More from coding & agent
- Base44 adds Entri integration: connect custom domains to your apps in a couple of clicks — tristanbob · 2026-10-25
- Grok Bot burns a week of Cursor Ultra quota in one day for a $200/mo user — alexcovo_eth · 2026-10-25
- Agent instruction files are executable code that skips code review, warns Cairnlock dev — augustkevinsanjaya · 2026-10-25
- Redditor builds unattended ticket-to-code pipeline with Linear and Claude Code — Awkward_Rent4749 · 2026-10-25
- dotey: Grokbot beats Claude Code and Codex for on-the-go mobile agent use — dotey · 2026-10-25
- DeepSeek 552B model runs on a single AMD MI325X: 4 agents at 100 tok/s — realmrfakename · 2026-10-25