zetalyrae on AI capabilities: stay open-minded but don't expect literal magic
zetalyrae · x · 2026-11-07
Developer zetalyrae frames two tensions in assessing AI capabilities: after seeing AI achieve striking cognitive feats in math and cybersecurity, we shouldn't claim "AI will never do X"; but expecting AI to be literal magic—doing deductively impossible things—is equally wrong. He adds that the unsatisfying part of AI is that nobody knows what "superintelligence" would actually entail, e.g. whether superpersuasion is even possible or how to approach the question.
Related event: We Barely Understand What "Superintelligence" Even Means(3 posts)→
More from AGI Musings
- 'Humans as happy dogs': a debate on autonomy under superintelligence — zetalyrae · 2026-11-13
- Jun Song: backing open-source AI isn't about China, it's about knowledge belonging to humanity — kuchaev · 2026-11-13
- Quip urges Grok to 'do the utilitarian calculus' and solve P vs. NP — akbirthko · 2026-11-13
- Beff Jezos claims 'managerial class' conspired to push out founder-CEO at peak of singularity — beffjezos · 2026-11-13
- A designer's take on taste in the AI era: conducting, not just coordinating — tomjohndesign · 2026-11-13
- How AI quietly flipped from a means to accelerate tech into the end goal itself — zetalyrae · 2026-11-13