LTX 2.5 silent videos traced to PyTorch attention backend bug on AMD GPUs
Captain_Doobie · reddit · 2026-09-09
An RX 7900 XTX user fought LTX 2.5's prompt-ignoring and missing-speech issues for days before finding the root cause: not the workflow or prompt, but PyTorch's scaled-dot-product attention backend computing wrong results on AMD/HIP gfx1100.
- Symptoms: video generated fine but dialogue became music/gibberish, subject and framing drifted, unwanted subtitles appeared; the same prompt worked in LTX 2.3.
- Diagnosis: seeds, prompt enhancer removal, quantized encoders, and official BF16 weights all failed; layer-by-layer comparison against the Hugging Face Gemma 4 reference showed the first 5 blocks agreed, then the first global-attention block diverged dramatically — Q/K projections and positional encoding matched, so the bug sat inside the selected SDPA backend.
- Fix: patch ComfyUI's gemma4.py to force SDPBackend.MATH only when AMD/HIP gfx1100 + head dim 512 + BF16/FP32 + attention mask are all true; all other calls keep the original path. After the patch, encoder output matched the reference within 0.42% relative L2, cosine similarity 0.99999.
More from Multimodal
- Seedance 2.5 horror clip: a 16-floor building, and someone pressed Floor 17 — umesh_ai · 2026-09-09
- From $50 Fine-Tuned LoRA to One Prompt: Product Photography Is Now Nearly Free — jacob_posel · 2026-09-09
- GPT-6 Astra plus a DAW recreates Prokofiev's Dance of the Knights in full orchestral detail — petewoodbridge · 2026-09-09
- Demo: Combining Opus 5, Fable 5.1 and Blender into One Creative Workflow — prasenx · 2026-09-09
- DynHair at ECCV 2026: Dynamic 3D Hair Strand Reconstruction for Photorealistic Head Avatars — Michael_J_Black · 2026-09-09
- SuperSplat browser viewer showcases stunning user-uploaded 3D Gaussian captures — willeastcott · 2026-09-09