Auto Ontology benchmark: Google Surf MCP 116/120 edges out NVIDIA 113/120
GarrixMrtin · reddit · 2026-11-11
A developer benchmarked NVIDIA's new Auto Ontology against the Auto Ontology feature in his own Google Surf MCP project.
- Setup: 48 source files covering 16 open-weight models and 120 questions; the same DeepSeek model with a shared prompt generated SQL from each system's retrieved evidence, run against the same database.
- Results: Google Surf Auto Ontology scored 116/120, NVIDIA Auto Ontology 113/120.
- The accompanying image highlights structural differences in the auto-built ontologies: NVIDIA's is tree-like and hierarchical, Google Surf's is hub-and-spoke.
Code and full write-up are public; the author is soliciting feedback.
More from coding & agent
- Matt Shumer's new video clarifies when to use Fable 5.2 vs Opus 5.5 — prasenx · 2026-11-11
- Rabbit insider: OS3 auto-responds to bug reports and drafts fixes in seconds — jesselyu · 2026-11-11
- Anthropic launches Claude Meetings: Claude joins Google Meet calls and does tasks live — No-Gazelle1365 · 2026-11-11
- Vibe coding Contra with Claude: one HTML file, zero assets, self-testing AI — prasadpilla · 2026-11-11
- GitHub's 2GB Cache Limit Bites as Celesto CI Offers 25GB Per Repo — aniketmaurya · 2026-11-11
- One Prompt Designs PCB, Enclosure and Firmware: Indian Manufacturer Urges Peers to Adopt AI — DrDatta_AIIMS · 2026-11-11