From-scratch open decoder-only reranker built with just a few GPUs

lintool · x · 2026-10-10

Lin (Yonghui) Trotman's team reports a milestone: a competitive pointwise decoder-only reranker built completely from scratch — pre-trained on ClimbMix, then supervised fine-tuned on RLHN relevance data — using only a few GPUs, and "it wasn't even that hard." Fully open and transparent, demonstrating anyone can reproduce it.

Related event: Project Greenhouse Trains Open-Source Search Reranker From Scratch on a Few GPUs(4 posts)→

Original post →

More from Research

Research channel →