The residual stream muddies the debate: is placing things in the right directions really packing?
livgorton · x · 2026-10-16
In part 13 of her thread, livgorton says the essay's residual-stream discussion makes the disagreement especially unclear: "A stream can hold far more than it has dimensions just by placing things in the right directions, so this alone isn't packing." She interprets this as a claim about composition.
The passage suggests part of the dispute stems from mismatched definitions of packing vs. superposition vs. composition.
More from Research
- UCSD Researchers Propose Dataset Watermarking Detectable via Black-Box API Access — yuxiangw_cs · 2026-10-16
- EmbodiedEvo tops RoboDojo as agents inherit reusable skills and lessons — Aiden_Tech_Ai · 2026-10-16
- CHI reviewer laments: papers' Discussion sections now cite nothing — IanArawjo · 2026-10-16
- Casper: Understanding 90% of neurons ≠ understanding the network — StephenLCasper · 2026-10-16
- NVIDIA Launches cuPotential in CUDA-X to Bring AI Agents to Semiconductor Materials Simulation — tomaszbednarz · 2026-10-16
- Agentic Search Systems Are Rewarded Only for Final Answers, Raising Faithfulness Concerns — burkov · 2026-10-16