Tiny2.1 ported to Amiga 500: an LLM running on 1MB RAM at 0.2-0.4 tokens/s

azhadron · reddit · 2026-11-17

A developer ported Tiny2.1 to the 1987 Amiga 500 with just 512KB+512KB (A501) of RAM, running the original model at 0.2-0.4 tokens/s. Some compromises were made on KV cache, and the video is sped up, but it genuinely runs. Repo coming soon.

Original post →

More from Fun

Fun channel →