Wici Infer offers free large-model serving on consumer hardware via VRam+Ram+SSD

AlexDorofeev · reddit · 2026-11-17

A Redditor spotted that Wici, which advertises a wireless GPU approach for local model serving, now offers Wici Infer for free — a technology claiming to serve large models on consumer hardware by defragmenting models and keeping hot experts in fast memory across VRam, RAM and SSD. They're asking whether anyone has tested it and if the official benchmarks hold up; no independent results yet.

Original post →

More from Infra

Infra channel →