Fine-tuned Inkling 2 Mini routes tickets with early exit: median latency 136.8ms to 81.4ms at 0.07% accuracy cost

eltokh7 · reddit · 2026-11-23

A developer released Inkling 2 Mini Decision, an Apache 2.0 fine-tune that returns answer probabilities without generating tokens, letting a looped transformer spend fewer passes on easy decisions.

Weights and eval scripts are open on Hugging Face.

Original post →

More from Infra

Infra channel →