Defining Transformer: architecture mixing inputs across feature and sequence dimensions
PandaAshwinee · x · 2026-08-18
Clarifying the definition of a Transformer, the author states that it is any architecture that mixes inputs across both the feature and sequence dimensions.
More from Research
- Best Project Award: Safe Pareto Improvements via Information Structure Modification — ghadfield · 2026-08-18
- Audit-Repair Context Shifts LLM Verifier Thresholds Toward Leniency — Parsa Mazaheri · 2026-08-18
- KAIST's AnyTalk: video diffusion models generate 3D speech animation for arbitrary characters — KAIST · 2026-08-18
- Self-organized Boolean Computation via Neural Cellular Automata — zzznah · 2026-08-18
- Ultra-fast Fourier transform and optical AI with a single lens — MeasurementDull7350 · 2026-08-18
- Developer releases playground to visualize how LLM text watermarking works — grabcard · 2026-08-18