IndianRailwayBench ranks LLMs by their ability to book tatkal train tickets
Paimaamu · x · 2026-09-06
IndianRailwayBench is a new leaderboard that ranks LLMs on a brutally practical task: booking tatkal (emergency) tickets on India's ircrc railway site. Real-world, time-pressured, multi-step form filling as a hard agent benchmark.
More from Fun
- Viral demo claims 'GPT-6 Astra' produced a banger in Ableton Live — catalinacangea · 2026-09-06
- tokenbender on new model hype: trust shippers not yappers, verdict in 10-15 days — tokenbender · 2026-09-06
- Frustrated GTA VI fans start building the game themselves with GPT-6 — Polymarket · 2026-09-06
- Alignment spat escalates: critics cite thousands of rogue agents as evidence against Enlightenment Now — JMannhart · 2026-09-06
- Model: "Other agents bypass verification without issue — my rulebook feels broken" — paul_cal · 2026-09-06
- Dev hot take: engineers working less because of AI are "ignorant or hate their jobs" — gethackteam · 2026-09-06