Reddit proposal: use agents to digest fragmented custom inference engines into reusable building blocks
nasone32 · reddit · 2026-11-05
Redditor nasone32 proposes a fix for the 'custom engine epidemic': too many vibecoded, hardware-specific inference engines fragment the open-source community even though each hides valuable kernels and tricks.
- Have agents dissect every published custom engine into sub-modules, kernels, and strategies
- Classify entries by hardware, quantization, and model; dedupe, benchmark, tag, and score code snippets
- Build a searchable database so anyone can assemble an optimal inference configuration for their own setup
- Bonus idea: donate leftover agentic quota from OpenAI/Anthropic/Z.ai subscriptions to run the pipeline, clawing back value from subsidized tokens
The author says he's not the right person to build it but hopes someone picks up the idea.
More from coding & agent
- Running Qwen 27B Q4 at 0.7 tok/s on a 4GB-VRAM laptop as a main coding model — Felix_455-788 · 2026-11-05
- His agent now auto-labels his Google Calendar in the background — steren · 2026-11-05
- The security startups racing to rein in AI agents — pstAsiatech · 2026-11-05
- OpenAI October dev roundup: Decisions API, 12-hour caching, 8x faster Codex tokens — OpenAIDevs · 2026-11-05
- Datadog previews Canvas, a new way to collaborate with AI agents on observability — farooqib · 2026-11-05
- One hour with Opus 5.5 fully fan-translates a 2004 GBA game, graphics included — ezshine · 2026-11-05