MIT Releases FinanceGym Dataset; Kimi and Qwen Fail Tests
MIT_CSAIL · x · 2026-08-25
MIT CSAIL researchers released "FinanceGym," the largest dataset for finance agents yet, featuring over 59K samples across 37 roles and 40 apps/sites. The dataset addresses the challenge of locked private corporate data in finance agent training. Benchmarks show that even advanced models like Kimi K3 and Qwen 3.8 Max failed to pass its test set.
More from Research
- Pathway CSO pitches BDH as post-Transformer architecture uniting memory, reasoning, adaptation — schwentker · 2026-10-15
- EmbodiedEvo tops RoboDojo at 38.95% success by letting robots inherit failed practice — thetripathi58 · 2026-10-15
- 797GB of n-gram counts in CPU RAM let 1B models match 57% more compute — PangWeiKoh · 2026-10-15
- Google's HARNESS² evolves agent harnesses without verifiers, up to +11.5 points on WorkBuddy-Bench — dair_ai · 2026-10-15
- Subbarao Kambhampati to dissect the 'mythos of LLM thinking tokens' at UMN — rao2z · 2026-10-15
- How 3D Gaussian Splatting gives robots spatial memory of what's out of view — TheTuringPost · 2026-10-15