Lemire ports V8's fast UTF-16 string-fixing algorithm to C# in SimdUnicode
lemire · x · 2026-09-27
Daniel Lemire explains how to quickly fix ill-formed UTF-16 strings in C#, where lone surrogates (common with emoji) make strings unsafe to persist or transmit. His PR #54 in SimdUnicode adds ToWellFormed/IsWellFormed using the same algorithm contributed to V8, so Chrome already fixes strings this way.
More from Research
- Free Open-Source Site Lets You Deep-Read Einstein's Four 1905 Papers — doodlestein · 2026-09-27
- 119k papers later: top-venue acceptance exploded from 968 to 19,003 per year since 2006 — angelaqdai · 2026-09-27
- GEPA reflection beats RL: 3 examples outgain GRPO's 25k rollouts, ARC-AGI to 89.5% — AI Engineer · 2026-09-27
- Study: AI access drops people's willingness to say "I don't know" from 44% to 3% — The Decoder · 2026-09-27
- Bagel fine-tune packs detection, OCR, depth and masks into one 7B-active model — mostlyired12 · 2026-09-27
- Blanche Minerva's five-step pipeline shows why "just next-token prediction" no longer fits LLMs — BlancheMinerva · 2026-09-27