Fireworks AI VP: Nexus Router Is Itself a Trained Model, Not Rules

sophiamyang · x · 2026-11-04

Chris Harris, VP of Product Engineering at Fireworks AI, explained the design of Nexus, the company's model router, at a live event.

A "team of models" beats one superstar: models have distinct personalities and strengths; a diverse bench will matter more than any single top model.
Nexus is a router that is itself a trained model, routing on fit (matching model quirks to task attributes, beyond just the prompt), cost (preserving cache hits, predicting token count, reasoning effort, and tool calls), and personalization (learning who is asking over time).
Fireworks' moat is not building its own models but the orchestration layer above them.

More from Infra