Hobbyist attempts DIY RLHF on a llama2-13b base model checkpoint: "this is so hard"
cephaloform · x · 2026-11-10
User cephaloform shares that they got one of their favorite base models ever and are RLHF-ing a llama2-13b checkpoint themselves, noting "this is so hard." A hands-on hobbyist fine-tuning anecdote without further technical detail.
Related event: Hobbyist Attempts DIY RLHF on Llama2-13B to Make It Post by Itself(2 posts)→
More from Models
- Fable IS Mythos with more guardrails, users say as Anthropic calls them two models — repligate · 2026-11-10
- Open-source Mirage model trends on Hugging Face with zero-shot detection and VQA — Cactus-Compute · 2026-11-10
- Anthropic deliberately capped Claude's AI-research capabilities; ML researcher sees years of runway — A_K_Nain · 2026-11-10
- 400M model handles game NPC judgment calls in ~0.1s on a 3060 Ti, Apache-2.0 — NoahPersaud · 2026-11-10
- Fable 5.2's most surprising trait: no new open problems solved — sytelus · 2026-11-10
- Sailing Sim Eval: Fable 5.2 First Claude Model to Steer Live, Argon Costs $0.73 — shekitup · 2026-11-10