Cloudflare AI Search Update: Build a Dedicated Search Engine for Your Agents
Cloudflare Blog · rss · 2026-08-06
Cloudflare announced major developer experience upgrades for AI Search, moving from manually stitching together primitives to an out-of-the-box solution designed to give AI agents their own dedicated search engine for data.
Key Updates:
- Data Indexing & Parsing: Supports indexing unstructured data, individual files, and owned websites. A new "Discover" parsing option allows crawling sites without a sitemap.
- Public Endpoints & MCP: Enabling public URLs instantly generates /search and /mcp endpoints for unauthenticated searches across multiple instances. Users can add custom domains or secure them with Cloudflare Access.
- Pricing Preview: Free during beta. General availability pricing aims for predictability: embedding and reranking are completely free when using default models, with costs only for ingestion tokens and queries.
Cloudflare also highlighted real-world usage, such as powering the new Cloudflare Dev Stack MCP to provide coding agents with current, cited documentation, replacing inefficient web search fallbacks.
More from coding & agent
- How to Build an AI UGC Factory in Claude Code: From Beginner to Autonomous Ad Generation — EXM7777 · 2026-08-06
- Cloudflare Introduces Kitesurf: An Agent-First Browser in V8 Isolates — michellechen · 2026-08-06
- Open Source Toolkit MCPfy Simplifies MCP Server Creation and Management — ZealousidealTax42 · 2026-08-06
- Engineering Practices for Agent Latency and MoE Training Bottlenecks — arpit_bhayani · 2026-08-06
- 1,200 Researchers Used Coding Agents to Reproduce Over 2,000 ICML Papers — Gradio · 2026-08-06
- Microsoft's SUTRADHARA paper reveals two best practices for cutting agent latency — arpit_bhayani · 2026-08-06