Inkling Runs 2-Minute Consultation Audio Locally
MaziyarPanahi · x · 2026-07-16
A user reported further testing Thinking Machines' Inkling with excellent results. Follow-up details reveal they ran the model on a Mac Studio using a 2-minute doctor consultation audio sample.
Key takeaways from the post include:
- The model processes real audio directly, rather than relying on transcribed text
- While the initial complaint mentioned was a "knee issue," the model successfully identified and flagged the actual critical risk: heart failure
- The parameter scale is listed as 975B params
- It utilizes the 1-bit GGUF version
- It runs locally on llama.cpp, ensuring "nothing leaves the machine"
Overall, this is a hands-on showcase of local inference for massive models and native audio comprehension.
Related event: Testing 975B Inkling Model Locally for Accurate Audio Processing(4 posts)→
More from coding & agent
- AWS on agent prompt caching: explicit + implicit patterns to slash token costs — AWS ML Blog · 2026-10-27
- He gave his AI agent a phone number and email — then hired it as social media manager — heyshrutimishra · 2026-10-27
- Firecrawl launches Alexandria company-data API and announces $75M Series B — devdigest · 2026-10-27
- 'Let an agent run wild on vague goals and it makes your code worse 9 out of 10 times' — eptwts · 2026-10-27
- LangChain to demo the in-house design agent its team uses daily, this Wednesday — LangChain · 2026-10-27
- Biotech Agent Series Day 8: A Notebook Review Agent to Auto-Audit Lab Records — nlarusstone · 2026-10-27