Unsloth Desktop Update: Auto Compaction and LAN Remote Access
danielhanchen · x · 2026-08-21
Unsloth released version v0.1.801-beta, merging over 200 PRs. Key features include:
- Auto Compaction (Experimental): Uses a mix of RAG, forced 1st turn RAG, and tail truncation to allow long chats to exceed context limits while keeping evicted turns searchable.
- Remote & LAN Access: Easier network access without Cloudflare links.
- Performance Improvements: Better streaming, reduced UI lag, and smoother conversations.
- Unsloth Dynamic v3.0: New Qwen2.5-27B GGUF models deliver >10% higher top-1 accuracy.
More from Infra
- DecagonAI achieves sub-30ms latency for real-time TTS — dhruv2038 · 2026-08-21
- US union warns: New England data center bans could kill thousands of jobs — Polymarket · 2026-08-21
- Waymo Cuts Hardware to $20k, Tesla Aims for Cybercab COGS Under $20k — JOBhakdi · 2026-08-21
- Cursor's Git Storage System: S3 as Source of Truth, Local Disk as Cache — xennygrimmato_ · 2026-08-21
- AMD ROCm 10.1 fixes major issues: LLaMA.cpp runs flawlessly on RDNA2 — smellof · 2026-08-21
- RAG vs CAG: KV Cache Cuts LLM Costs by 90% — blaizedsouza · 2026-08-21