Toto-2.0: Advancements in Time Series Forecasting
nkafr · reddit · 2026-07-09
The post introduces Toto-2.0, a multivariate time series forecasting model released by Datadog research, emphasizing its goal to scale time series forecasting "like an LLM." Key designs include replacing autoregressive decoding with Contiguous Patch Masking, using arcsinh normalization to preserve small fluctuations, and a NorMuon optimizer better suited for pinball loss.
The post also mentions the model uses u-µP hyperparameter transfer: tuning on a 10-million parameter proxy model before transferring to multiple target scales. Links for further discussion and tutorials are provided.
More from Research
- OpenAI says long-horizon models need safety and alignment checks across full action sequences — rhiever · 2026-07-22
- A Reddit user proposes a consistency LoRA to keep anime and game scenes visually stable — ThirdWorldBoy21 · 2026-07-22
- Graph workload 854.graph500 enters SPEC CPU 2026 as a new CPU benchmark — Prof_DavidBader · 2026-07-22
- BlackboxNLP 2026 is recruiting extra reviewers after a high submission volume — hanjie_chen · 2026-07-22
- AWS shows self-distilled reasoning can preserve math and coding skills during SFT — AWS ML Blog · 2026-07-22
- UI2App shows screenshot fidelity still lags real interaction recovery — Grace Man Chen · 2026-07-22