Local legal PDF test: hy4-flash beats QFN on citation accuracy at 10 tps vs 15
tsunami_forever · reddit · 2026-11-20
A legal professional compared hy4-flash (4-bit) against QFN (5-bit) for local PDF-heavy legal work on 26GB VRAM + 128GB DDR4.
- Accuracy: hy4-flash is substantially better at accurately citing the law, a key requirement for legal workflows
- Speed trade-off: 10 tps vs QFN's 15 tps
- Author concludes hy4-flash is currently the best local model for legal work and invites others to replicate
More from Infra
- Open-source Intern harness: Opus 5.5 hands off to Hy4 Flash, 92.4% at 1/3 the cost — m4rkGS · 2026-11-20
- Report: AI is vastly more compute-intensive than any prior workload, and needs no new user base — BenBajarin · 2026-11-20
- Analyst: Robot hardware demand will overwhelm supply by orders of magnitude for years — Rewkang · 2026-11-20
- AMD was crowned winner of Nvidia's China crisis — but it has a China problem of its own — CurieuxExplorer · 2026-11-20
- Matt Slotnick questions Hunterbrook's AMD story: 'seems really flimsy' — matt_slotnick · 2026-11-20
- LFM3-1.7B impresses in medical long-context work: 20k tok/s prefill on a 3090Ti — AdRepulsive7837 · 2026-11-20