mitsuhiko: use any llama.cpp model with Pi as a discount classifier
mitsuhiko · x · 2026-09-30
mitsuhiko shares a practical tip: if you run llama.cpp with Pi, you can use any model there as a discount version of Jev for classification tasks. Results may vary, but it's a low-cost trick worth trying.
More from coding & agent
- GamowLabs' LabBench: AI Agents Struggle to Pick the Next Best Wet-Lab Experiment — danielmckinn0n · 2026-09-30
- fal opens its Agent to everyone: image, video, audio and 3D in one interface — adamho · 2026-09-30
- marimo tip: GitHub filesystem support ends git clone friction in classrooms — S_Conradi · 2026-09-30
- marimo adds remote storage to molab notebooks with S3, GCS, Google Drive and HF support — S_Conradi · 2026-09-30
- Builder Shares Three Agent Directions: Sims+Sensors, Explorer Agents, and Personal Taste Models — pzakin · 2026-09-30
- 104 structured judgments for $0.0018: lessons in cheap LLM evals — WolframRvnwlf · 2026-09-30