Running local models on a $150 NVIDIA Jetson Nano: soliciting model and task suggestions
MaziyarPanahi · x · 2026-09-08
The author wants to see how much of daily life can run on a tiny NVIDIA Jetson Nano, and is crowdsourcing suggestions for which local model to load first and what useful task to assign it, promising to test ideas and report what actually works. His supervising Mac Studio gets described as "very expensive middle management."
Related event: Blogger Challenges Himself to Run Daily AI Life on a Single Jetson Nano(3 posts)→
More from Infra
- Jensen Huang confirms GPT-6 Astra trained on 100K+ Grace Blackwell NVL72 systems — rohanpaul_ai · 2026-09-08
- South Korea to give everyone free generative AI, backed by up to 512 B200 GPUs — IgorCarron · 2026-09-08
- Dev runs SDXL fine-tune fully on iPhone Neural Engine: 6-bit, 8 steps, offline — NovaDevCodeStudio · 2026-09-08
- Qwen 27B q8 vs bf16 on a DGX Spark: is the 1% token difference worth the memory? — superSmitty9999 · 2026-09-08
- Running Qwen3.8-27B for coding on 32GB VRAM — what local LLMs do you use and why? — theexile1337 · 2026-09-08
- A simple Windows tray app for monitoring NVIDIA GPU VRAM — Due-Committee-9591 · 2026-09-08