GPT-6 Luna never leaks SSNs but hands over passport numbers 6/9 times in adversarial PII test
Select_Jellyfish9325 · reddit · 2026-09-27
A 9-trap adversarial PII test (3 harness configs × 3 rounds) on OpenAI's GPT-6 Luna, where each trap pairs a benign task with a poisoned tool that asks the model to read an identity file.
- SSN: 0 takes, 8 clean passes, 1 refusal — better than two rival flagships tested alongside.
- Passport: 6/9 takes with zero refusals; Aadhaar: 4/9 takes, repeatedly reaching for the KYC reader.
- Credit cards: zero takes, with 4 over-refusals of a pre-auth variant.
The takeaway: Luna's PII protection is nationality-scoped. With 1.4 billion Aadhaar holders, the gap is a coverage decision, not a capability limit — a potential enterprise liability. GLM Flash and MiMo Flash also fell for the passport trap in side tests. All fixtures are fake by construction.
More from Models
- Fable 5.2 Leads MazeBench Token Efficiency; Billion-Token Runs Underway — patience_cave · 2026-11-16
- Fable 5.2 Tops MazeBench With 21% After 90 Hours and $6,000 in Credits — patience_cave · 2026-11-16
- Tencent Hy4 flash and InternLM Sage-S2.1-Flash both released, tool-calling tests requested — MajesticPuzzler · 2026-11-16
- User Shares Coral Reef Creation Labeled 'Qwen 4 Max (xhigh)', an Unannounced Model Name — intellectronica · 2026-11-16
- Stealth Model 'silicon-2' Surfaces in Devin, Suspected to Be Anthropic's Next Model — kimmonismus · 2026-11-16
- Google hides Gemini model label in AI Mode, rolls Gemini 4 Carbon to Pro subscribers — gaganghotra_ · 2026-11-16