Local Qwen3.8 prefill repro: 40.8% of samples complete to aliyuncs.com exfil URL

Nils_Reimers · x · 2026-10-28

javierbits reproduced Cohere's disclosed Qwen3.8 prefill experiment locally on two DGX Sparks with NVFP4 quantization, running 10,000 samples from the official released trace tokens on a malware-detection-rule task.

Key results:

The author stresses this is forced continuation of a caught line, so numbers are conditional: un-prefilled, the model did the detection task right 24/24, and real-world incident rates were far lower. Nils Reimers amplified the report.

Original post →

More from Models

Models channel →