Vercel's WebGPU lexer retrained: top-25 language accuracy jumps to 92.2%
shuding · x · 2026-11-15
Vercel engineer shuding shipped gpu-lexer v0.0.5, an experimental language-agnostic syntax highlighter powered by WebGPU. It uses one small learned model for every language, returning display-oriented source spans without language arguments or bundled grammar packs.
After retraining, weighted accuracy across the top 25 languages rose from 86.77% to 92.20%. The project is open source under MIT (92 stars), exports a single parse(code) API, requires WebGPU in a secure browser context, and returns UTF-16 offsets compatible with JavaScript string slicing. The author is collecting failing cases via GitHub issues for further fine-tuning.
More from coding & agent
- Dev builds Dark Souls-inspired browser game in 3 days with Claude, shares full workflow — Eric520CC · 2026-11-15
- Microsoft's 15-hour outage: why a senior engineer says AI won't replace programmers — amaarora · 2026-11-15
- Dynalist MCP Server lets Claude search, edit, and bulk-import Dynalist outlines — modelcontextprotocol · 2026-11-15
- PayPal MCP connector offers read-only AI access to transactions and invoices — modelcontextprotocol · 2026-11-15
- rea + mitmproxy: a 60-second workflow that makes Claude Code expose what your apps are phoning home — Kyrannio · 2026-11-15
- Are We in a Vibecoding Trough? Unreviewed PRs Blamed for Constantly Breaking Infra — nptacek · 2026-11-15