ContextBridge: an open-source pool that routes AI tasks across local machines, APIs and shared hosting
IamAngusU · reddit · 2026-09-22
Developer IamAngusU released ContextBridge, an open-source project that eliminates re-writing model integrations for every app: applications declare what they need (task, model, RAM/VRAM, policy), and the pool ranks compatible workers by current capacity, with route explain showing why a candidate was picked.
- Example: a PHP app on shared hosting submits work via a relay and gets it executed by a model on a home PC — no GPU, shell or ContextBridge process needed on the host
- Works with Ollama, APIs and other runtimes, can manage a llama.cpp runtime itself, and includes durable schedules, deterministic pipelines, MCP and a bounded planner that can't exceed its budget or change egress rules
- Deliberately conservative trust boundaries: explicit worker pairing, scoped credentials, optional E2EE, no silent replay of ambiguous executions
- Pre-1.0; core is AGPL-3.0, listed interfaces Apache-2.0; the author used AI for docs, review and parts of coding/testing
Repo: https://github.com/IamAngusU/ContextBridge
More from coding & agent
- Jimothy distills LLM queries into tiny task-specific classifiers running 10-20x faster — flngr · 2026-09-22
- What Cloudflare can't do: D1 caps at 10GB, is single-threaded, and no real Postgres — Paimaamu · 2026-09-22
- User Vibecodes Tampermonkey Scripts to Patch Long-Ignored UX Bugs in University Systems — craig_macdonald · 2026-09-22
- Speaking UI layouts into existence with Jev, shadcn and a local transcription model — _AustinCalvert_ · 2026-09-22
- ai-copywriter hits 1k stars: an agent skill that writes converting copy with zero AI tells — tom_doerr · 2026-09-22
- Microsoft's 44-page playbook: 100+ internal AI projects show licenses alone fail — alex_verem · 2026-09-22