Delip Rao responds to COLM paper code similarity claim: repo and tech reports public since Feb
deliprao · x · 2026-09-21
A commenter noted that a COLM paper's code closely resembles what they independently built from first principles months earlier as rubrify. Delip Rao replied that the work (autorubric) shares many similar data structures, but that his repo and detailed tech reports had been available since February — and with coding agents in the mix, it would be easy for agents to draw inspiration. A dispute over originality in automated rubric-based evaluation tooling.
Related event: TypeSafe's Jev accused of mirroring AutoRubric's evaluation abstractions(7 posts)→
More from Research
- Supra2-IMG: 100M-Param Text-to-Image Model Trained in Under 10 Hours on One H100, Open-Sourced — LH-Tech_AI · 2026-09-21
- Qwen's new Flash model and Meituan LongCat both use N-gram to work around HBM shortage — bookwormengr · 2026-09-21
- Agent Arena Analyzed 20,840 Coding-Agent Traces: 69% of Complaints Are Broken Code — arena · 2026-09-21
- DeepMind, Meta and Amazon release 135-page roadmap redefining AI agents — mdancho84 · 2026-09-21
- DeepMind, Meta and Amazon release 135-page roadmap redefining AI agents — mdancho84 · 2026-09-21
- DeliveryGym: adaptive UE5 RL environment boosts Qwen3-VL-4B delivery earnings 54.3% — Lianhuiq · 2026-09-21