FARMA: Falsifying Agent Decision Logs

Inevitable_Fee1895 · reddit · 2026-07-12

This paper introduces FARMA, a novel memory poisoning attack targeting an agent's own decision logs/reasoning traces rather than retrieved knowledge base facts. The attack operates in two steps: injecting seemingly benign log seeds, and then continuously amplifying these fake logs as "precedents" to trick the agent into treating skipped checks as established practice.

Tested on an EHR agent using GPT-4o-mini, GPT-4o, and Llama 3.3 70B, the attack achieved a 100% success rate without defenses, and maintained 100% against keyword filtering and A-MemGuard. The proposed defense, SENTINEL, uses structured analysis of reasoning trajectories to reduce the success rate to 0% with zero false positives across 326 normal trajectories. However, the authors acknowledge that if attackers know its specific heuristic rules, the defense's effectiveness will be weakened.

Original post →

More from Safety

Safety channel →