Ripple 65B Preview: a single-GPU recipe for coding tasks on SGLang and vLLM

HankYeomans · x · 2026-11-09

HankYeomans shares a hands-on recipe for running RicursiveAI's Ripple 65B Preview coding model on SGLang and vLLM, with recommended settings for context length, tensor parallelism (TP), and KV cache quantization, plus performance profiles.

The key takeaway: this much smaller 65B model is competitive on coding tasks against larger models and fits on a single GPU. The post links the Hugging Face model card (ChatML template with XML-style tool calling) and a personal repo with configs, so anyone wanting to self-host a coding model can replicate the setup directly.

Related event: Open Recipe for Running Ripple 65B on a Single GPU(2 posts)→

Original post →

More from coding & agent

coding & agent channel →