Weaviate paper: LLMs misuse LIKE instead of search operators when querying databases
CShorten30 · x · 2026-09-14
A Weaviate paper, Querying Databases with Function Calling, proposes a unified tool definition for database querying supporting search, filters, aggregation and multi-collection routing. Using a Gorilla-adapted synthetic pipeline (DBGorilla benchmark, compared to BIRD/Spider/WikiSQL) across 8 LLMs from 5 families, they show Claude 3.5 Sonnet and GPT-4o handle it well — but LLMs frequently use LIKE or exact text match operators for natural language commands requiring a SEARCH operator.
Related event: Paper: LLMs Prefer LIKE Over Semantic Search When Querying Databases(2 posts)→
More from coding & agent
- User builds 20-bot Grok suite to track wins, prep 1:1s and close promises — NicoVerderosa · 2026-10-30
- LangChain CEO opens Interrupt London with keynote on why orgs should own their intelligence — LangChain · 2026-10-30
- Simlock: open-source control plane gives parallel coding agents their own iOS/Android simulators — Scobleizer · 2026-10-30
- YC experiment: Claude agents formed democracies while GPT agents formed hives — soumitrashukla9 · 2026-10-30
- Keyfleet launches open canvas where personal AI agents team up with a shared USDC treasury — seanwbren · 2026-10-30
- Page-based project management for Grok Bots: keep chats short, history on Pages — AiJohnAllen · 2026-10-30