Cohere researcher: labs should share validation loss and idea throughput, not efficiency gains

eliebakouch · x · 2026-11-06

Cohere's Elie Bakouch argues there's a spectrum between hoarding confidential info and sharing nothing: pre-training efficiency gains over previous architectures don't help competitors even if disclosed, so labs could share things like monorepo validation loss (as OpenAI used to), SFT->RL SWE-bench results, or hinted scaling laws. He also suggests quantifying METR interview claims — e.g. ideas generated per researcher per week with Claude + scaffold.

Related event: Researcher Argues Pretraining Efficiency Gains Can Be Disclosed Without Helping Rivals(3 posts)→

Original post →

More from Research

Research channel →