Neshter: a fully local tool to visualize, measure and prune attention heads in small LLMs

Bayqus · reddit · 2026-11-22

A developer released Neshter (Apache-2.0), a 100% local tool for inspecting attention heads in small language models—no cloud API, no account, no telemetry.

Key features:

Limits: designed for models up to 8B (author mostly uses 0.1-3B), requires eager attention, falls back to CPU, tested on Windows and Linux, Android build from source only, v0.2 one-person project.

Original post →

More from Research

Research channel →