GLM-5.2 Reads 3-Year Medical Record Locally
MaziyarPanahi · x · 2026-07-15
The author shares how they successfully used GLM-5.2 to process a 3-year patient medical record, with the raw data strictly confined to the local Bonsai 27B model.
Key details include:
- All 292 visit notes are stored locally in Bonsai on a Mac Studio.
- The tech stack consists of llama.cpp, Metal, and ternary; the model size is 7.2GB under the Apache-2.0 license.
- The medical records never left the local machine. GLM-5.2 could only ask questions, which Bonsai answered sequentially in about 2 seconds each.
- The model eventually identified a risk factor hidden for 17 months: the combination of metformin and iodinated contrast given an eGFR of 39.
The author also mentions that a 1-bit version could reportedly shrink the model to 3.9GB, allowing it to fit onto an iPhone 17 Pro Max. The main highlight is this local privacy architecture where the orchestrator never touches the raw data.
Related event: Mac Studio Runs 27B Model Locally to Process 3-Year Medical Records(2 posts)→
More from Models
- Kimi K3.1 Pro tops MathArena open models, closing frontier gap to about 6 months — teortaxesTex · 2026-10-26
- Ruff creator Charlie Marsh: frontier models find infinite bugs in any software — charliermarsh · 2026-10-26
- Dev testing one skill across Opus 5.5 and Sol 6.1 finds instruction following 'all over the map' — lucasmeijer · 2026-10-26
- supermemory unveils learner-1, claiming continual learning for any model — julianweisser · 2026-10-26
- Anthropic says Opus 5.5 cuts cost per task by ~40% vs Opus 5 — taufiqintech · 2026-10-26
- AI search APIs ranked: top 12 within 7 points, yet prices differ nearly 7x — FinanceYF5 · 2026-10-26