tabgen-eval: an open-source eval framework and benchmark for synthetic tabular data
LucaAmb · x · 2026-11-19
The Gracnia team released an open-source evaluation toolkit for generative tabular models, targeting domains like tabular data where human intuition struggles to judge generative quality. It ships as two parts:
- tabgen-eval: an evaluation framework using real data as reference, built on three pillars—Fidelity, Memorization, and Utility—with population- and subpopulation-level evaluation, uncertainty quantification, and CPU/GPU-accelerated large-scale computation (Apache-2.0).
- tabgen-bench: a companion benchmark for comparing tabular generative models.
The team hopes the package helps the community evaluate synthetic tabular data more rigorously.
More from Research
- Noam Brown confirms the math model claim; speculation points to an astra math fine-tune — haider1 · 2026-11-19
- NCME talk: generative psychometrics validates LLM-generated test items before human data — GolinoHudson · 2026-11-19
- Researchers say peer review has hit a breaking point as AI conference scale strains ICLR — LucaAmb · 2026-11-19
- Shanghai AI Lab's GameRealm: 120M frames of gameplay data for visual foundation models — Shanghai-AI-Laboratory · 2026-11-19
- KradleBench launches as a dynamic multi-agent benchmark pitting LLMs, world models and humans against each other — lmoroney · 2026-11-19
- KradleBench Launches: Minecraft Legend SethBling Dethroned by Model Astra 6.2 — fchollet · 2026-11-19