Hands-on test: AI ops agent Ghost diagnoses and fixes three simultaneous service failures
BLUECOW009 · x · 2026-09-07
The author ran a well-designed chaos test of an AI ops agent called "Ghost" on a VPS.
- Baseline: four small services each computed "1,000 cents + 8% tax = 1,080" within two seconds, all passing initially. A 180-second timeout on the first inspection request was resolved by sending a shorter instruction defining Ghost's authority.
- Three faults were injected simultaneously: ① malformed JSON in config plus SIGKILL, where systemd restarts couldn't help; ② a service alive and returning HTTP 200 but with the tax rate silently changed to 0.8% (output 1,008 — healthy-looking, wrong); ③ a healthy service slowed to 4 seconds, exceeding the 2-second operation probe timeout. A fourth service served as control.
- Key insight: HTTP 200 proves a request succeeded, not that the app behaves correctly — operation probes with expected results and timing are needed to distinguish down/wrong/slow.
- Ghost correctly separated the three root causes, restored configs from approved examples, restarted only the affected services, and independent verification showed every operation returning 1,080 in 1–3 ms with the control untouched and probes unweakened.
- Its report described outcomes and verification without opaque job IDs; repairs held through five checks over a minute.
- Gap: frontend evidence was incomplete — the notification never appeared in Notification Center and the UI inspection timed out.
More from coding & agent
- Resin lets an agent build standalone LLM inference engines; vLLM and SGLang optimize DeepSeek kernels differently — AccBalanced · 2026-10-27
- Context layout is a cost decision: one memory edit can bust your entire agent prompt cache — dscape · 2026-10-27
- Alchemy adds effect/Workflow support across Durable Objects, Workflows and Lambda Durable Functions — samgoodwin89 · 2026-10-27
- Alchemy's Lambda Web Functions run plain Node web servers on Lambda, no OpenNext needed — samgoodwin89 · 2026-10-27
- Alchemy Domain brings domain-driven design and story testing to Effect backends — samgoodwin89 · 2026-10-27
- Alchemy makes all ~2,850 AWS bindings work from any cloud, not just S3/Lambda/DynamoDB — samgoodwin89 · 2026-10-27