Using Internal Model Signals for Training Isn't Always Bad
gleech · x · 2026-07-19
The author discusses the classic "Most Forbidden Technique": whether using a model's internal representations as training signals is truly always undesirable.
The article argues that a blanket rejection of such methods is often exaggerated. While acknowledging that these practices are linked to "obfuscation" and require caution, the author contends that using internal model information shouldn't be equated directly with a bad practice—it depends on the specific conditions.
Reviewing relevant literature, particularly the contribution of The Obfuscation Atlas, the author plans to summarize the exact conditions under which using internal model signals during training is worth adopting.
More from Safety
- PHP2Shell exploits confirmed in the wild, attackers may use agentic AI for post-exploitation — AravSrinivas · 2026-10-27
- php2shell exploit benchmark: only 2 of 5 frontier models can port the bug — xeophon · 2026-10-27
- Interactive 32-slide AI security & privacy lecture for lawyers, now public — chrisrohlf · 2026-10-27
- Two CVSS 9.9 Wasmtime flaws allow sandbox escape, one ARM64-only since 2020 — basedjensen · 2026-10-27
- Free prepare.aiendgame.com site guides users through locking down accounts amid AI cyberstorm — harris_edouard · 2026-10-27
- Cisco routers trust eMudhra CAs whose private keys were numbers under 256 — murat_kocaoglu_ · 2026-10-27