Same bypass, reposted: conftest.py and pytest.ini defeat locked test suites for agents
Weary-Information-15 · reddit · 2026-10-20
A repost of the author's earlier thread (disclosed: he's building in this space, no link). Directory-shaped protections — blocking writes to tests/, read-only mounts, hidden suites, base-commit runs — are bypassed by a root-level conftest.py or a modified pytest.ini: collection changes, protected assertions never run, and pytest still exits 0, indistinguishable from a real pass to any exit-code gate. He treats collection-controlling files as part of the verified surface and asks which holes others are living with, plus how to keep false-hold rates low enough that people keep reading holds.
Related event: Agent Can Bypass Test Directory Locks via conftest.py and pytest.ini(2 posts)→
More from coding & agent
- 99% don't know 'record a skill': computer use agents' ceiling is nowhere near — alliekmiller · 2026-10-20
- Swapping to Qwen when GPT refuses your prompt is like typing sudo — DanGrover · 2026-10-20
- Letting an AI agent 'live a life' in a 30-year-old MMORPG: a Reddit experiment proposal — Aeylwar · 2026-10-20
- NYU professor builds EdgeBar with Cursor: a floating macOS sidebar for Edge profiles — kchonyc · 2026-10-20
- OpenAI Platform quietly adds a Decisions API playground with Predicate, Choice and Score modes — testingcatalog · 2026-10-20
- "Capable models don't imply productivity — they enable stupidity at superhuman scale" — generativist · 2026-10-20