Running llama2.c on a 2006 iPod: int8-only port hits 0.36 tok/s at 80 MHz
r0tlier0 · reddit · 2026-11-02
A developer wrote a Rockbox plugin running Karpathy's llama2.c TinyStories models on an iPod video 5.5G (2006, ARM7TDMI @ 80 MHz, 64MB RAM, no FPU). Without an FPU, the runq.c code was ported to pure integer math: lookup tables for exp/softmax and an integer square root for RMSNorm. The 15M model is only 17MB, loaded straight off the hard drive into the music buffer, running at 0.36 tok/s. Next steps: using both cores and an iPod-themed local music recommendation model.
More from Fun
- Squirrels knocked out Nasdaq twice, putting cyberattack risk in perspective — sebkrier · 2026-11-02
- Why do LLMs love saying "No X. No Y" instead of "No X or Y"? — AlpinDale · 2026-11-02
- Stardock CEO uses AI agents to animate game characters without rigging, runs 101 agents — draginol · 2026-11-02
- Deepinder Goyal teases mystery 'Cervix' device, promises vibration option in replies — DrDatta_AIIMS · 2026-11-02
- AI short film 'Shakespeare on a Xenoplanet' shows cinematic armor character — Gertywood · 2026-11-02
- Remaking Hell's Kitchen starring his cat with AI video, day one — venturetwins · 2026-11-02