Testing Qwen3.8 Vision: SVG Reconstruction & Anti-Benchmaxxing
bonobomaster · reddit · 2026-08-26
The author designed a benchmark for Qwen3.8-27B to test SVG and vision capabilities in a way that resists 'benchmaxxing'. The task is simple: recreate any given photo as an SVG using the prompt "Recreate as SVG".
Extensive testing revealed that the best results come from --image-min-tokens 1024, --reasoning-effort xhigh, --temperature 1.0, and bf16 KV caches. Notably, q40 quantized caches severely degraded output quality, while q80 performed well. The author also suspects the chat template influences output quality.
More from Models
- Grok Voice 3.0 reportedly powers Tesla in-car assistant with millions of daily conversations — XFreeze · 2026-10-15
- Gemini 4 Argon coding style: neat one-line comments, but does the code actually work? — zacharynado · 2026-10-15
- Why ChatGPT beats the better Claude with mainstream users: being first known — aitrendz_xyz · 2026-10-15
- 'You need high pain tolerance to review Gemini 4,' researcher quips amid error screens — gleech · 2026-10-15
- MiniCPM-V 4.7 runs a 35B MoE multimodal model on phones with just 3GB memory — nevrekaraishwa2 · 2026-10-15
- Gemini 4 Argon wrote 5,000+ lines of pure Python to build its own ray-tracing 3D engine — aitrendz_xyz · 2026-10-15