Inkling Multimodal Model Crashes on Audio Due to Hardcoded Dimensions

MaziyarPanahi · x · 2026-08-01

Developer @MaziyarPanahi discovered that the audio processing feature in the Inkling-Small model crashes. The root cause is a hardcoded nembd = 6144 in the Inkling PR, while Inkling-Small actually uses 4096 dimensions, triggering an assertion error.

Deriving the dimension from the tensor fixes the issue, while image functionality remains unaffected. The patch is being sent upstream.

Related event: Inkling-Small Shines in Medical Parsing but Faces Audio Bug(2 posts)→

Original post →

More from Models

Models channel →