Fixing Ill-Formed UTF-16 Strings With SIMD, 9x faster
lemire · x · 2026-08-26
Daniel Lemire published a new paper on fixing ill-formed UTF-16 strings using SIMD instructions (ARM NEON and x64 SSE/AVX2/AVX-512). It achieves 18.9 GB/s on Apple M4 and 7.5 GB/s on Intel Ice Lake, using as little as 0.4 instructions per byte, up to nine times faster than the old method. The code is in Chromium browsers, and String.prototype.toWellFormed in Node.js 25 is about five times faster.
Related event: SIMD Repairs Malformed UTF-16 Strings 9x Faster(2 posts)→
More from Infra
- Vemetric Post-Mortem: Outbid's Viral Launch Broke Ingestion — jonathan_wilke · 2026-08-26
- Opinion: Local AI is the solar of computing — heyneighbor · 2026-08-26
- Archil Doubles WAL Write Speed of S3 Express One Zone — s4chinraja · 2026-08-26
- Nordic data centers face high power bills amidst AI boom — nordicinst · 2026-08-26
- Cerebras CS4 is 30x faster than GPUs but 200x pricier — zephyr_z9 · 2026-08-26
- Start retrieval systems with full-text search for low-volume queries — petrusenko_max · 2026-08-26