CrideLLMApi: an open-source .NET 10 OpenAI-compatible client for llama.cpp that hides nothing
cride20 · reddit · 2026-09-09
Developer cride20 open-sourced CrideLLMApi, a .NET 10 OpenAI-compatible client aimed mainly at llama.cpp with a 'don't hide the protocol' philosophy: raw streamed chunks, reasoning deltas, tool-call fragments, finish reasons, cancellation, typed request objects, context management, strongly typed tools, and concurrent tool execution — plus a simple high-level path.
It's built as a low-level API layer under an experimental async tool-calling harness where generation continues while tools execute in parallel; the harness will stay separate from the library. Only /v1/chat/completions is implemented so far; actively in development, with a NuGet package planned. Repo: github.com/cride9/CrideLLMApi
More from coding & agent
- Full-AI pipeline turns Blender city into stylized video via GPT, DepthAnything and Hailuo — Hailuo_AI · 2026-09-09
- Founder notes: FDEs are the new McKinsey, and legacy firms can't hire AI-native talent — yihui_indie · 2026-09-09
- Routing ~50 tools for a local agent: three failed approaches and a GBNF fix — paulqq · 2026-09-09
- Tabular foundation models over LLMs for predictions: talk at AI Engineer Paris — helloiamleonie · 2026-09-09
- Kimi Work launches Remote Control: drive your desktop agent from your phone — Kimi_Moonshot · 2026-09-09
- Vulcan brings CAD into the Ontology: engineering geometry becomes operational data — pdamodaran · 2026-09-09