rasbt proposes an LLM building-block API to cut switching costs in open-source LLM research

TheTuringPost · x · 2026-11-17

Sebastian Raschka argues the open-source LLM ecosystem needs an "LLM building-block API." Today, components are scattered across codebases, making it painful to swap GQA for MLA, dense FFNs for MoE, attention for Mamba2/Gated DeltaNet, or standard residuals for attention residuals in experiments and ablations—even with LLM-assisted coding.

He envisions it built on top of PyTorch or CUDA, but carefully engineered and maintained rather than weekend vibe-coded, and efficient enough for researchers to trust. Others echoed the call for "LEGO for LLMs" as every new open model rewrites the same attention block with a twist.

Related event: Raschka calls for building-block API for open LLMs(2 posts)→

Original post →

More from coding & agent

coding & agent channel →