Local Testing of Inkling 276B: Accurate Heart Failure Diagnosis

Developers successfully ran the 3-bit quantized Inkling 276BA12B multimodal model locally, accurately diagnosing heart failure from a 2-minute audio sample. Tests reveal that the 12B activation variant outperforms the 41B version, consuming 93GB of VRAM at a 32k context length.

2026-08-01 ~ 2026-08-01 · 3 related posts

• Local Quantized Inkling 276B Model Accurately Diagnoses Heart Failure from Audio — MaziyarPanahi · 2026-08-01
• Inkling 12B Active Params Outperforms 41B Version in Medical Diagnosis — MaziyarPanahi · 2026-08-01
• Local 276B Multimodal Model Inference: 93GB VRAM at 32k Context — MaziyarPanahi · 2026-08-01