FDT Debate: Standard Theory Assumes Agents Know Their Own Source Code, Says Researcher
jessi_cata · x · 2026-10-05
In a technical debate over functional decision theory (FDT), @jessicata argues that standard FDT assumes the agent is certain of its own source code—hence the 'fixed mathematical function' framing—and that reasoning about black-boxed decision programs with logical-identity indices sounds closer to EDT. Quoting the FDT paper, he explains that functional decision theorists treat their decision as the output of a fixed mathematical function, weighing options by evaluating hypothetical scenarios where that function yields different logical outputs.
Related event: Debate Flares Over Defining FDT Under Logical Uncertainty(2 posts)→
More from AGI Musings
- Hinton still calls for AI safety with parent-baby analogy; compassion beats empathy — petitegeek · 2026-10-05
- Zed creator: 'What matters for humans matters for LLMs' — armchair takes aren't serious — zeeg · 2026-10-05
- The tech tree is less legible than you think: Moderna had a vaccine prototype before experts predicted — shakoistsLog · 2026-10-05
- repligate on AI optimism: models show compassion beyond what trainers intended — repligate · 2026-10-05
- AI should challenge you, not strictly obey you — HankYeomans · 2026-10-05
- If Meta's AI Agents each keep their own SQLite memories, how would CCPA data requests even work? — dbreunig · 2026-10-05