Undocumented Strata tip: set default sampling params via a sampling block in run config
KissMyShinyArse · reddit · 2026-10-01
A non-obvious Strata engine configuration tip not covered in the top-level README: you can add a "sampling" key to your strata-iq3s. run config, e.g. {"sampling": {"temperature": 1.0, "topp": 0.95, "topk": 20}}. Per docs/DETAILS.md, this block sets defaults for requests that omit sampling fields, request-level values always win, and without the block a request lacking sampling keys decodes greedily. Practical for anyone running Strata locally.
More from Infra
- Arduino argues sub-$900 embedded boards beat Mac minis for Physical AI agent economics — CatAstro_Piyush · 2026-10-01
- SemiAnalysis injects failures to rate GPU cluster renters — providers differ sharply on recovery — AccBalanced · 2026-10-01
- Redditor runs unattended DeepSeek loops for days: 237M tokens for just $3.48 — dogfoodarchitect · 2026-10-01
- Free course built from Cornell's GPU architecture workshop now shared publicly — idanbeck · 2026-10-01
- Qwen Flash Next MTP work resumes with official GGUF quants and llama.cpp PR — jacek2023 · 2026-10-01
- Meta's Loop Scaling Laws: Sparsity Gives ~3x Active-Param Efficiency, Recurrence ~2x on Reasoning — facebook · 2026-10-01