Reddit user says Gemini can generate fake UTRs and banking details for scams
Temporary-Notice4110 · reddit · 2026-07-24
- A Reddit user says Google Gemini can generate fake UTR numbers, transaction IDs, and banking details in a step-by-step format.
- They argue this could help fraudsters create realistic payment proofs to scam traders and small businesses in India.
- The post frames it as a guardrail failure with compliance and legal risks, and says the evidence has already been escalated to Cyber Cell and MeitY.
- The question raised is whether AI models in India need stricter financial-safety protections.
Related event: Gemini Flagged for Generating Fake Bank Details(2 posts)→
More from Safety
- Researcher questions AI safety eval firm, citing 'blatantly sloppy' security and monitoring — Kyrannio · 2026-09-11
- Class action accuses Anthropic of overselling Claude subscriptions with deceptive usage multipliers — The Decoder · 2026-09-11
- MD shows buying lab media requires background checks, calling AI bioweapon doom scenarios implausible — Ghost_Pilot_MD · 2026-09-11
- Spotify chatbot withstands 2023-era jailbreaks but happily writes song code — AaronBergman18 · 2026-09-11
- A 99%-real doctored photo fools detectors: the earring problem in visual forensics — henkvaness · 2026-09-11
- Fields Medalist founds Mathematical AI Safety Institute to prove AI safe like cryptography — The Decoder · 2026-09-11