Factory AI launches Legacy-Bench to test models on COBOL and legacy software
annbordetsky · x · 2026-09-25
Factory AI joined Fireworks AI's Specialized Intelligence Index with Legacy-Bench, testing how models handle the legacy software behind payroll and financial settlement, including COBOL. The SII keeps growing and is open to submissions from teams with proprietary benchmarks.
Related event: Factory's Legacy-Bench Tests LLMs on Legacy Code, Joins Fireworks SII(3 posts)→
More from Models
- Opus 5.5 coded a polished 30-second hype video from one prompt in 3 hours of autonomous work — DaveRogenmoser · 2026-09-25
- Yoav Goldberg: LLM reasoning traces are 'too good' — unclear how they emerge from RL — yoavgo · 2026-09-25
- One user's dream AI wishlist: 1000+ tok/s, unlimited $200 plan, every modality at once — TheMoonMidas · 2026-09-25
- Overnight Test: Fable 5.1, ChatGPT Astra and Grok 4.7 All Fail at Building a Cross-Lab Agent System — adam_dorr · 2026-09-25
- Using Jev embeddings for RAG: semantic matching beats dot product similarity — hardimanjames · 2026-09-25
- GPT 6.1 'Astra' Rumors Swirl as OpenAI's Release Pace Stuns Observers — bindureddy · 2026-09-25