CRUX-in-a-box: open-source infra for weeks-long agent evaluations
sayashk · x · 2026-11-06
Sayash Kapoor announced CRUX-in-a-box, open-source infrastructure for running and monitoring weeks-long agent evaluations, built from six months of long-horizon evals in CRUX.
- Run agents on VMs for weeks, repeatable, secure, and monitored
- LLMs flag risky actions for human review
- Inspect tool calls, tokens, and spend; set time and cost budgets
- Chat with agents mid-run to give feedback or answer questions
Available on GitHub for anyone running long-horizon agent experiments.
Related event: CRUX-in-a-box Open-Sources Infrastructure for Weeks-Long Agent Evaluations(3 posts)→
More from coding & agent
- Ampersand Claims 92.2% on SWE-bench Pro HARD-51 at 70% Lower Cost — niloofar_mire · 2026-11-06
- ServiceNow Brazil Release Touts 100x Gains with Autonomous Engineer — azavery · 2026-11-06
- LiteParse Integrates 1.3B MiniCPM-OCR, Beating Gemini Flash on ParseBench — llama_index · 2026-11-06
- Finix MCP Server lets AI agents create buyers, payment links, and search docs — modelcontextprotocol · 2026-11-06
- Agent Substrate ships an MCP server for fs/bash on actors with auto suspend-resume — rakyll · 2026-11-06
- Personal agents weekly: Tomo adds Shop Pay via MCP, Fo's Twilio calls span 100+ countries — heyneighbor · 2026-11-06