Datology AI builds synthetic pretraining data with measurable knowledge-cutoff guarantees for LLM backtesting
josh_wills · x · 2026-10-30
Backtesting LLM trading strategies requires data past the model's knowledge cutoff, but synthetic data breaks the guarantee: when a model rephrases documents it can inject information its sources never had, catastrophically contaminating backtests. Datology AI's new blog post presents a method to generate synthetic pretraining data with measurable, controllable knowledge-cutoff guarantees, achieving near-zero contamination even with the latest synthetic models.
More from Research
- WSDM 2027 to host LongSeek, first workshop on long-horizon information seeking — mrdrozdov · 2026-10-30
- Lean 4 formalization of an asymmetric metric-tensor physics paper hits GitHub — SubtleGradient · 2026-10-30
- Is sycophantic AI inflating research publications? Two mechanisms worth questioning — KLdivergence · 2026-10-30
- Tahoe AI's Tara plug-in brings 100M-cell drug datasets to Claude Code, Codex and Cursor — anshulkundaje · 2026-10-30
- Joy dataset: 100,000 hours of unscripted two-person calls to teach voice models real timing — Scobleizer · 2026-10-30
- Exo: Berkeley's self-improving agent architecture cuts costs 31-62% vs Codex — arena · 2026-10-30