llmman now runs Qwen-Image 2.1 locally straight from GGUF in Rust
danielhanchen · x · 2026-09-30
- The open-source tool llmman ("run any agent on any model") can now run Qwen-Image 2.1 locally, loading UnslothAI's GGUF weights directly on ggml, implemented in Rust.
- A single command generates an image, e.g. llmman run qwen-image-2.1 "A manatee in a sunlit lagoon".
- llmman's core pitch: point agents like Claude Code, Codex or OpenCode at local or hosted models; models are stored as OCI images, so they can be transferred between registries (e.g. Hugging Face → your own) like container images with no intermediate local copy.
More from coding & agent
- shadcn boosts @uisdk: one-shot UI rebuild that's instantly E2E-testable by AI — shadcn · 2026-11-16
- AI agent deletes 43,599 lines of OpenClaw test code in one PR — vincent_koc · 2026-11-16
- JPMorgan shows Jarvis, its internal agent assembly line, at Interrupt NYC — LangChain · 2026-11-16
- Dev clarifies: Apple doesn't ban feature flags, only fooling App Review — talkaboutdesign · 2026-11-16
- Antigravity Matches Claude Cowork in Tests, While Gemini Tasks' Purpose Remains Unclear — sebajun2 · 2026-11-16
- One 16GB GPU runs songs, voice, images, 720p video and local RAG — all offline and open source — llama-of-death · 2026-11-16