Prompt Tuning Is Forgotten Lore — Are We Massively Underusing Finetuned Tokens?
cephaloform · x · 2026-10-09
The author notes that prompt tuning (2021) has been almost completely forgotten and argues the community may be massively underusing finetuning tokens, along with the VRAM-maxing DreamBooth-style configs of that era.
They speculate that inference frameworks accepting raw inputids could unlock new possibilities, and that evolutionary methods might work exceptionally well for searching over trainable tokens.
More from coding & agent
- WorldBox spatial memory boosts Opus 5.5 Minecraft progress 133% and GPT-6 Astra 50% — Lianhuiq · 2026-10-09
- After GPT-6 Made Generative UI Mainstream, This Dev Argues the Next Layer Is Generative Workflow — Over_Accountant_2311 · 2026-10-09
- Next Token podcast ep.5: the Personal Agent wars, software replication, and small-hardware opportunities — op7418 · 2026-10-09
- mattyp's build a bot takes voice feedback via Grok, feeding each report to an agent for fixes — mattyp · 2026-10-09
- Reverse-engineering a 3D pixel-emoji animation style into a Claude artifact in 10 minutes — justin_hart · 2026-10-09
- How Delphi's Predict Anything works: LLM-generated odds seed an LMSR market — benfielding · 2026-10-09