AI agent collects 471 product reviews in 29 min and clusters complaints into themes
eyishazyer · x · 2026-11-05
Developer eyishazyer shows how to turn a product's public reviews into one spreadsheet with an AI agent — using Meta Ray-Ban Display as the test case with the Oxylabs Web API MCP server: 471 reviews in 29 minutes.
- Setup: install oxylabs/web-api-mcp via uv, add the web-api-skills, plug in an API key; ran Opus 5.5 in Claude Code (Cursor/Codex work too).
- One prompt: find public review pages for Meta Ray-Ban Display, skip login walls, collect all reviews from the last 12 months, dedupe, save to reviews.csv.
- Execution: 12 US-scoped searches, 57 scrape calls covering every Best Buy listing page plus Reddit; 25 calls pulled just the needed fields as JSON — 548 Best Buy reviews in, 462 kept, plus 9 Reddit posts.
- Second prompt, no new web calls: group complaints into 5–8 themes with counts, percentages, and exact quotes with links; results in 4 min: limited apps 23%, weight and fit 15%, battery 12%.
- Verification: every quote links back to its source review, and the agent itself flagged that all Best Buy reviews carried an "incentivized" badge.
Why Oxylabs: country-targeted search, markdown output agents can read directly, named-field JSON extraction, JavaScript rendering, and no charge for failed requests.
Related event: AI Agent Scrapes and Categorizes 471 Product Reviews in 29 Minutes(3 posts)→
More from coding & agent
- How one creator built a 113-second AI dialogue short with Seedance 2.5 and ElevenLabs — DavidmComfort · 2026-11-05
- rabbit launches OS3: browser-based agent OS with free hosted model, $20/mo plans — SimonBalmain · 2026-11-05
- Berkeley's Evolving Agent Teams beats FlashInfer by 1.2x with supervisor-run agent teams — burny_tech · 2026-11-05
- Paradev open-sources its agent platform under MIT license — AIFlow_ML · 2026-11-05
- Tutorial: build phone apps with memory using GPT Live and Twilio Agent Connect — craigsdennis · 2026-11-05
- Engineer says manual tweaks after Claude optimization made EC2 CPU 50x faster than M4 Max — _Stocko_ · 2026-11-05