TRiP: Transformer inference and training in plain C (Gemma, Llama2, PaliGemma)
RelevantShape3963 · reddit · 2026-08-21
Author released TRiP, a Transformer inference and training framework written in plain C (15k lines). It supports real checkpoints for Gemma1(.1), Llama2, PaliGemma1, and GPT2, including the multimodal path for PaliGemma. Designed for readability and debugging, it allows inspecting tensors anywhere in the forward/backward pass without hidden complexity. Includes training code (though PaliGemma encoder is not trainable).
More from Infra
- Running DeepSeek-V4-Flash on 64GB Mac: Small cache beats large — cowboy-bebob · 2026-08-22
- Request: Best setup for Qwen 3.8 27B on RTX 6000 Blackwell — ApolloPS2 · 2026-08-22
- Supermicro Investigation Clears CEO in $2.5 Billion Nvidia Smuggling Scheme — fortune · 2026-08-22
- Qwen3.8-27B: 3x Faster Long-Context Decoding with DFlash2 + XQA — stargate425 · 2026-08-22
- Monad Community Touts a New Era of 100ms Latency — tomwanhh · 2026-08-22
- Intel Arc Pro B70 Benchmarks: 52 tok/s with Qwen3.8-27B via vLLM XPU — No-Dot-Not · 2026-08-22