Weekend hack: Project Titania reimplements Qwen3-0.6B from transformer to GPU ISA simulator
generativist · x · 2026-09-14
Developer penberg open-sourced Titania, a from-scratch LLM stack where every layer — model kernels, instruction set, compiler, and GPU simulator — is small enough for one person to read and implement. It runs a real Qwen3-0.6B decoder-only transformer you can chat with; kernels compile to the Titania ISA and execute on an ISA simulator, with RTL GPU, FPGA, and silicon on the roadmap. Built as a weekend hack with help from Claude Code, it demystifies how LLMs actually run on massively parallel GPU hardware.
More from coding & agent
- Element Forge: open-source editable AI VFX for real footage in ComfyUI — zitroffell · 2026-10-30
- Gym-Anything Adds Audit Agents That Try to Break Simulations With Legal Robot Actions — wellecks · 2026-10-30
- CMU's Gym-Anything Auto-Builds 200+ Agent Environments from Any Software, Selected by GDP — wellecks · 2026-10-30
- durable-object-migrator: zero-downtime exports for Cloudflare Durable Objects — samgoodwin89 · 2026-10-30
- This 5-question interview prompt makes Grok design your first two custom bots in minutes — nateliason · 2026-10-30
- Cursor and Harvey swap general models for task-specific brains, but most niches can't afford to — MartinGTobias · 2026-10-30