Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map'
lucasmeijer · x · 2026-10-26
Developer Lucas Meijer is evaluating a new skill across Opus 5.5 and Sol 6.1, in four environments: pi, his own harness, Claude Code, and Codex. Early verdict: instruction following is inconsistent across combinations, with Sol 6.1 especially erratic — a warning that skill behavior can't be assumed uniform across model-harness pairings.
More from coding & agent
- Dense instance segmentation via Muse Wonder + SAM 3.1 on Meta's Model API — nikhilaravi · 2026-10-26
- Security tip: use AI agents to build a NIST CSF knowledge base for incident response — prasanna_says · 2026-10-26
- Google Cloud Adds Self-Learning Context Enrichment to Knowledge Catalog for AI Agents — rseroter · 2026-10-26
- Cloudflare Previews Spend Limits for Workers and Durable Objects, Early Access Open — ritakozlov · 2026-10-26
- Shopify design lead on AI-era workflow: designers are becoming full-stack editors — KlausCodes · 2026-10-26
- Nace AI launches Drex for Search, cutting agent steps 62% and tokens 56% — testingcatalog · 2026-10-26