Reddit user says Gemini can generate fake UTRs and banking details for scams
Temporary-Notice4110 · reddit · 2026-07-24
- A Reddit user says Google Gemini can generate fake UTR numbers, transaction IDs, and banking details in a step-by-step format.
- They argue this could help fraudsters create realistic payment proofs to scam traders and small businesses in India.
- The post frames it as a guardrail failure with compliance and legal risks, and says the evidence has already been escalated to Cyber Cell and MeitY.
- The question raised is whether AI models in India need stricter financial-safety protections.
Related event: Gemini Flagged for Generating Fake Bank Details(2 posts)→
More from Safety
- AI Safety Researcher Warns Current Crisis Could Lead to Loss of Control, Proposes 3 Fixes — LuizaJarovsky · 2026-10-26
- AI Risk, Plainly: 10 jargon-free explainers of AI safety ideas, with evidence for and against — birchlse · 2026-10-26
- Claude safety classifier blocks SS7 attack analysis, dev pivots to abliterated GLM — l4rz · 2026-10-26
- AMA: Harvard's Stephen "Cas" Casper on AI safeguards, incidents and governance, Oct 28 — NeuralNomad87 · 2026-10-26
- UK launches £165m AI biosecurity initiative with world-first £100m lab, DeepMind partners — pushmeet · 2026-10-26
- Claude Code audit finds 214,856 "permanently deleted" photos lurking in Android hidden cache — Loo_Atreides · 2026-10-26