GLM-5.2 Reads 3-Year Medical Record Locally
MaziyarPanahi · x · 2026-07-15
The author shares how they successfully used GLM-5.2 to process a 3-year patient medical record, with the raw data strictly confined to the local Bonsai 27B model.
Key details include:
- All 292 visit notes are stored locally in Bonsai on a Mac Studio.
- The tech stack consists of llama.cpp, Metal, and ternary; the model size is 7.2GB under the Apache-2.0 license.
- The medical records never left the local machine. GLM-5.2 could only ask questions, which Bonsai answered sequentially in about 2 seconds each.
- The model eventually identified a risk factor hidden for 17 months: the combination of metformin and iodinated contrast given an eGFR of 39.
The author also mentions that a 1-bit version could reportedly shrink the model to 3.9GB, allowing it to fit onto an iPhone 17 Pro Max. The main highlight is this local privacy architecture where the orchestrator never touches the raw data.
Related event: Mac Studio Runs 27B Model Locally to Process 3-Year Medical Records(2 posts)→
More from Models
- Gemini 3.6 Flash appears live in Studio with $1.50 input pricing — ivan_bezdomny · 2026-07-21
- Artificial Analysis ranks Gemini 3.6 Flash at 50 on its updated intelligence index — Angaisb_ · 2026-07-21
- Google appears to have quietly shipped Gemini 3.6 Flash, with lower pricing and better agentic scores — xiaohu · 2026-07-21
- Google ships three more Gemini variants while 3.5 Pro slips again — Miserable-Archer-631 · 2026-07-21
- Google Quietly Launches Gemini 3.6 Flash: Cheaper, Stronger, and Agentic-Focused — OwariDa · 2026-07-21
- A user says 10–12 hours with Claude equals 3–4 hours with Grok Build — Daniel_Farinax · 2026-07-21