Ask Astra to write a security audit prompt and it adds "do not invent CVEs"
morqon · x · 2026-10-26
A user asked Google's Astra to write a security audit prompt, and the model inserted its own instruction: "do not invent CVEs."
The line is telling — the model apparently knows it's prone to hallucinating plausible-looking but nonexistent CVE identifiers in security contexts, so it guards against itself. A knowing wink to anyone who has watched LLMs fabricate vulnerability IDs.
More from Fun
- Muting is social media's most underrated superpower, says viral post — signulll · 2026-10-26
- Professor catches student cheating with AI who left the prompts in the paper — venturetwins · 2026-10-26
- Kling 3 comedy short 'Missed Spooning': three days alone and he can't find a single spoon — Agreeable_Lack_5303 · 2026-10-26
- Wikipedia has an entry for Preserved Fish, a real 19th-century NYC merchant — tallinzen · 2026-10-26
- Similarweb: Meta Muse dominates 18–34, Grok Bot leads 35–44 by nearly 10% — alexandr_wang · 2026-10-26
- ChatGPT's viral "roast me" prompt backfires: model mocks user for forgetting to fill in template — generativist · 2026-10-26