Meta’s WHALE paper unifies Wukong-style interactions and HSTU sequence modeling
_reachsumit · x · 2026-07-21
Meta’s WHALE paper proposes a scalable unified recommendation model based on the Wukong-HSTU architecture.
- The model combines Wukong-style high-order feature interactions with HSTU-style sequence modeling in every layer.
- The fusion is done through attention-based mechanisms.
- The post frames WHALE as a unified architecture for recommendation rather than a product announcement.
More from Research
- Talk at Geometry of ML 2026 shows AI finding and recommending resolutions to open math conjectures — wellecks · 2026-09-11
- Fast ViT shows strong ImageNet results; scaling runs needed next — ducha_aiki · 2026-09-11
- Loss Functions Are Scientific Assumptions: MSE Implies Gaussian Noise, Cross-Entropy Implies Bernoulli — bravo_abad · 2026-09-11
- SymKit MCP: 44 tools for AI agents to verify symbolic derivations — Foreign-Specific-604 · 2026-09-11
- Researchers: LLMs under pressure invent new languages unreadable to humans — mikeflache · 2026-09-11
- Mi-Ripple fixes ripple artifacts left by iterative AI image editing — Miyang-AI · 2026-09-11