Julius: Security tool identifies 60+ LLM services on network endpoints in seconds
tom_doerr · x · 2026-08-09
Security firm Praetorian has open-sourced Julius, an LLM service fingerprinting tool on GitHub. Designed for penetration testing and attack surface discovery, the tool can scan network endpoints to identify the AI server software running on them within seconds.
Unlike tools that identify which LLM generated a piece of text, Julius focuses on identifying the underlying server infrastructure. It currently supports detecting over 60 AI service software including Ollama, vLLM, and LiteLLM, helping security teams quickly spot unauthorized or exposed LLM deployments within corporate networks.
More from Infra
- MLCommons launches MLPerf Endpoints, a benchmark that measures inference endpoints the way buyers actually purchase them — TheKanter · 2026-10-16
- Neocloud M&A decoded: CoreWeave, Nebius, Crusoe, Nscale all bet margins vanish beyond GPU scarcity — AccBalanced · 2026-10-16
- AI-Driven Timing-Aware Power Optimization Uses Learned Ranking With Baseline-Preserving Repair — Amit Sharma · 2026-10-16
- Nscale AI datacenter plagued by coolant leaks, transformer fire, 10 safety violations — saranormous · 2026-10-16
- WSL 3.0 ships with native containers and Linux 6.18 kernel, syscall overhead down ~16% — solyarisoftware · 2026-10-16
- Are 22 GB modded RTX 2080 Ti cards a viable budget local LLM option? — Dave86ch · 2026-10-16