Tideway: phase-aware unified memory pool speeds MoE inference on consumer devices by ~2x

DukeUniversity · hf · 2026-11-19

A Duke University-led team presents Tideway, a system for efficient inference of large Mixture-of-Experts models on memory-constrained consumer devices.

Original post →

More from Infra

Infra channel →