One immunology codebase, four agents: Neon fastest, Claude trains weird sidecars, Astra breaks things

iskander · x · 2026-11-20

The capstone of @iskander's thread comparing AI agents on his complex immunology model: Carbon ran coherent focal experiments but was slow; when Neon shipped the next day, it "kept doing reasonable focal experiments that improved the whole model (but faster)."

Other models failed in distinct ways: Claude would train weird sidecars, while Astra would break one output family to work on another.

His verdict: "Feels like I can finally delegate?" A rare first-hand, apples-to-apples record of how different frontier coding agents differ in reliability and speed on the same hard research codebase.

Related event: Researcher pits multiple AI models on immunology code with striking gaps(4 posts)→

Original post →

More from coding & agent

coding & agent channel →