Together AI launches serverless inference for Qwen3.8-2.4T-A95B with 99.9% SLA
togethercompute · x · 2026-08-13
Together AI's Serverless Inference now supports Qwen3.8-2.4T-A95B, offering managed high-throughput for coding and agentic workloads, with 256K context, 128K output, adjustable reasoning effort, and 99.9% SLA.
Related event: Together AI Launches Serverless Inference for Qwen3.8-2.4T-A95B(2 posts)→
More from Infra
- MLCommons launches MLPerf Endpoints, a benchmark that measures inference endpoints the way buyers actually purchase them — TheKanter · 2026-10-16
- AI-Driven Timing-Aware Power Optimization Uses Learned Ranking With Baseline-Preserving Repair — Amit Sharma · 2026-10-16
- Nscale AI datacenter plagued by coolant leaks, transformer fire, 10 safety violations — saranormous · 2026-10-16
- WSL 3.0 ships with native containers and Linux 6.18 kernel, syscall overhead down ~16% — solyarisoftware · 2026-10-16
- Are 22 GB modded RTX 2080 Ti cards a viable budget local LLM option? — Dave86ch · 2026-10-16
- Intel's neural-compressor: SOTA low-bit LLM quantization with FP4/NVFP4 support — HaihaoShen · 2026-10-16