Wici Infer offers free large-model serving on consumer hardware via VRam+Ram+SSD
AlexDorofeev · reddit · 2026-11-17
A Redditor spotted that Wici, which advertises a wireless GPU approach for local model serving, now offers Wici Infer for free — a technology claiming to serve large models on consumer hardware by defragmenting models and keeping hot experts in fast memory across VRam, RAM and SSD. They're asking whether anyone has tested it and if the official benchmarks hold up; no independent results yet.
More from Infra
- Altman explains 'double counting' warning: chipmakers all assume OpenAI will buy their supply — toptickcrypto · 2026-11-17
- RightNow launches inference API, claims 14x NVIDIA performance via GPU kernels — ycombinator · 2026-11-17
- Baseten open-sources Rust/CUDA DeepSeek engine; agent on Vera Rubin finds optimizations speeding Blackwell by 10% — baseten · 2026-11-17
- Benchmark shows new e-means clustering 100x slower than Lance's hierarchical k-means — leland_mcinnes · 2026-11-17
- 943 agents, 11.5B tokens, $5,900: 97% of tokens went to re-reading context — chrisfirst · 2026-11-17
- MCP server returns parquet handles instead of rows, cutting 3.2M tokens to 1,700 — Daniel_Aperiodic · 2026-11-17