Chollet: AI Benchmarks Must Include Marginal Costs

François Chollet argues that reporting single scalar benchmark scores is now meaningless without including efficiency metrics. He emphasizes that marginal cost is the most crucial factor in AI evaluation, analogous to assessing airline value based on specific costs and times rather than general coverage.

2026-07-07 ~ 2026-07-07 · 2 related posts