Test: ChatGPT Work gives up mid-trip-planning; Gemini flagged for wrong flights
DynamicWebPaige · x · 2026-09-16
A user tested big-co AI assistants on the canonical task "organize me a trip based off today's e-mail," with all necessary connectors active, while waiting for Muse in Europe.
Result: ChatGPT Work does stuff and browses, and is good at finding train connections and decent hotels, but then fails to check room availability and price at two hotels and gives up.
Google's Paige reshared it, tagging GeminiApp and Josh Woodward for visibility, especially flagging the wrong flight destination.
Related event: Hands-on test: AI travel agents stumble on hotel booking(3 posts)→
More from Models
- 'You Can Feel the Gradient Slopes': Dev Contrasts Benchmaxxed RL Models vs General Ones — theteknosaur · 2026-11-02
- LightOnOCR-3 Launches: Tops FRBench, Adds Layout Structure and Chart Extraction — IgorCarron · 2026-11-02
- NVIDIA's Kumo Is a Family of Four Tabular Foundation Models, Not Just One — pandeyparul · 2026-11-02
- SemiAnalysis: safety classifiers are underrated — Meta's Muse tops cyber benchmark at 35.2% — ThomasScialom · 2026-11-02
- DeepSeek V4.1 Flash 1017 wins over a longtime closed-source-only user: fast, cheap, reliable — _bachrc · 2026-11-02
- Local quants vs Claude on 9 real private bugs: 3-bit costs thinking time, not score — FeydRowan · 2026-11-02