How to eval a self-improving bank: NIM and RoA as the real AI metrics
NirantK · x · 2026-09-10
A 10-year ML/NLP veteran sketches an eval framework for AI at a bank: separate "measuring improvement" from "self-improvement." Using shareholder-lens metrics — Net Interest Margin and Return on Assets — he argues genuine AI efficiency gains must show up directly in those numbers. A practical take on enterprise AI eval design.
More from AGI Musings
- Sheryl Crow posts AI doom acrostic as celebrities join the safety chorus — Miles_Brundage · 2026-09-10
- Hallucination benchmark release coincided with rapid model improvement — what that means for alignment — StrategicHarmony · 2026-09-10
- Can satire defeat AI doomers? One South Park episode may be all it takes — beffjezos · 2026-09-10
- Mollick follow-up: navigating a decade of AI-driven change needs careful policy and management — emollick · 2026-09-10
- Gary Marcus asks: any concrete AI-extinction scenarios beyond the Yudkowsky-Soares book? — GaryMarcus · 2026-09-10
- Ethan Mollick: Even if AI development stopped today, current models would roil work and education for a decade — emollick · 2026-09-10