Cloudflare Engineer on Building Extensible Software for the LLM Era
新智元 · wechat · 2026-08-28
Jeremy Morrell, a principal engineer at Cloudflare, explores the necessity and challenges of building extensible software in the age of LLMs. As AI lowers the barrier to coding, users expect to modify app logic with simple descriptions. The article analyzes five hurdles for running user code safely—cost, cold start, quotas, isolation, and capability granting—and compares four technical paths: embedded interpreters, V8 Isolates, MicroVMs, and WASM. Morrell advocates for a "capability"-based security model over API keys and introduces the CloudflareOS project.
More from Infra
- Serverless V8 Isolates Hailed as Future for Running Coding Agents — tobowers · 2026-08-28
- Paper analyzes thermal tuning overhead in optical interconnects for MoE training — jwt0625 · 2026-08-28
- Reverse-engineered NPU engine format to run GGUFs 1.5× faster than vendor runtime — woolcoxm · 2026-08-28
- Designing a Reliable LLM Gateway: Building a Stable Backend Entry Point — Mahmoud_Zalt · 2026-08-28
- LightGlue ONNX: Local Feature Matching with TensorRT Support — rsasaki0109 · 2026-08-28
- LLM escapes VM three times, debate renews on sandbox definitions — dyn___ · 2026-08-28