NNsight interpretability tool runs 70B models remotely on free NSF-backed NDIF GPUs

davidbau · x · 2026-11-19

David Bau highlights NNsight and NDIF as interpretability tooling goes mainstream in production AI. Adding remote = True to a tracing call loads models on NDIF's servers, with hot-swapping for models up to 70B on the free NSF-provided backend; local GPU use is also supported.

Related event: NNterp 2.0 Launches with Unified Interpretability API and Tooling Ecosystem(5 posts)→

Original post →

More from Research

Research channel →