Running Local LLMs on Shared Machines with Zero Data Retention
Developer-Y · reddit · 2026-08-24
A user plans to run the Qwen 3.8 model on a shared university machine for research involving confidential patient data. The primary requirement is ensuring no chat history or application logs are saved on the remote server. The user notes that tools like OpenCode and DeepSeek harness retain sessions and asks for inference engines or configurations that guarantee zero data persistence.
More from Infra
- Infrastructure shift: Agent CPU scheduling & GPU prefill define new 'Pareto optimal' — AccBalanced · 2026-08-24
- Qwen 2.5 27B Quantization Benchmark: Q4 Viable, Q6 Safest — Fun-Meaning-6474 · 2026-08-24
- LLM Caching Strategies: Reduce Latency, Cost & Model Load — blaizedsouza · 2026-08-24
- Overseas data center shift won't stop AI buildout, costs local economy — QuintinPope5 · 2026-08-24
- GoatRemote stable release integrates Groq for ultra-fast TV control — mayfer · 2026-08-24
- DS4 vs oMLX for DeepSeek V4 Flash on Mac Studio? — ShittyMillennial · 2026-08-24