Gemma fine-tune generates working ELF binaries directly, skipping the compiler entirely

matthewhaynesonline · reddit · 2026-11-02

CRAP (Compiler Replacement for Assembling Programs) is a Gemma 4 E2B fine-tune that takes prompts like 'generate a Linux x8664 binary that prints boop' and emits working ELF binaries as hex — no compiler, assembler, or tool calls. v1.1 evals (scored on run/print/exit behavior): novel strings 26/40 (v1: 8/40), multi-turn 10/12 (v1: 0/12), unseen exit codes 23/25. Notably, one training run hit 0.038 loss while failing 11/12 trained exit codes. The browser demo loads a 3.6 GiB Q6K GGUF via wllama on WebGPU (scores 109/144 vs f16's 114/144; Q4KM scores just 3/144). Limited to print-and-exit programs — a compiler does this deterministically in milliseconds. Weights, code, 'paper', and demo all public.

Original post →

More from Fun

Fun channel →