Inkling 2 Mini Now Runs on vLLM, Ending the 'Permanent Underclass'
VoidAsuka · x · 2026-11-21
A user reports successfully running Inkling 2 Mini on the vLLM inference stack, joking it's a 'privilege to escape the permanent underclass' — a follow-up to Ahmad Osman's earlier quip that 'Inkling 2 Mini = permanent underclass canceled.' The post signals the small model is now workable with vLLM for local/self-hosted inference.
More from Models
- Mathematician Levent Alpöge claims proof of Riemann Hypothesis co-discovered with Claude — burny_tech · 2026-11-21
- Google reportedly changing privacy and AI training opt-in controls — blackice193 · 2026-11-21
- Tao announces AI-assisted proofs: Euler/Navier-Stokes blowup and Generalized Riemann Hypothesis — burny_tech · 2026-11-21
- VideoMemBench shows LLMs forget video chats: best model scores just 45.7 across 25 tested — 机器之心 · 2026-11-21
- 7.5M TTS model holds prosody on long sentences: kale-tts-nano f0 std 2.97 st matches 45.7M sibling — NERDDISCO · 2026-11-21
- OVH's Olala Mini 7A1B: 360 tok/s decode on one RTX 5090, 96K context, v2.0 to exceed 100B — JiliJeanlouis · 2026-11-21