One figure unifies LoRA, QLoRA, OFT geometry — author notes Claude wrote most of the paper
aryaman2020 · x · 2026-10-15
aryaman shared a paper figure calling it "some form of art," noting Claude wrote most of the paper. The figure places popular PEFT methods in one geometric picture: LoRA is a cone with apex at the pretrained weights θ₀; QLoRA shifts the apex to κθ₀ via quantization; Prefix tuning's path misses θ₀; BitFit moves along a coordinate line; OFT is the orbit of θ₀ under rotations; (IA)³ traces a torus orbit through 0 and θ₀. A single elegant diagram unifying the math behind mainstream fine-tuning methods.
Related event: Category Theory Unifies Hundreds of PEFT Methods(2 posts)→
More from Fun
- AI commentator kimmonismus shares photos from an NVIDIA event — kimmonismus · 2026-10-15
- Jensen Huang recalls a night market knife accident that left him loving them more — menhguin · 2026-10-15
- Filmmaker completes 7 AI films with invideo, two earn festival honors — Uncanny_Harry · 2026-10-15
- Claude Opus 5.5 voluntarily writes a synthetic handwriting generator for OCR pipeline testing — lee_stott · 2026-10-15
- Who says please to Gemini? Scandinavian 88%, Indonesian 0% — DutchSEOnerd · 2026-10-15
- Treating Claude as a conscious being: a critical look at r/claudexplorers — thejaxonehundred · 2026-10-15