Open source Pelican SVG Env quantifies model drawing abilities
SergioPaniego · x · 2026-08-24
The author built Pelican SVG Env, a quantifiable evaluation environment based on Simon Willison's "pelican on a bicycle" meme. Built with OpenEnv, TRL, and HF Jobs, it scores model SVG outputs. The post provides two commands: one to evaluate any model and another to train models on a GPU. The environment includes 30 task combinations of 6 animals and 5 vehicles.
More from Models
- OX-Alpha outperforms DeepSeek-V4 in coding benchmarks: Test — karminski3 · 2026-08-24
- Qwen2.5-72B tops HuggingFace likes, surpassing QwQ-32B — choose_a_guest · 2026-08-24
- Agnes-AI quietly posts Agnes-2.5-Pro-Alpha on Hugging Face — External_Mood4719 · 2026-08-24
- Rumor: Kimi K4 to be significantly larger, aiming to rival GPT-6 — iamaliveix · 2026-08-24
- Continuous diffusion language models are making a comeback, Sander Dieleman writes — joao_gante · 2026-08-24
- Testers hint OpenAI is trialing a significantly more capable model — haider1 · 2026-08-24