Call for Submissions: Architecture BIM Benchmark
brunorosilva · reddit · 2026-07-12
This is a call for help regarding an Architecture BIM Benchmark: the author's team is working on construction cost estimation AI and plans to release a public benchmark.
They have already had professional construction estimators perform item-level takeoffs on blueprints, followed by multiple reviews by construction experts to ensure maximum annotation accuracy. This benchmark will be open for testing models and will include their methodology and a comparison of LLM performance on the task (e.g., Fable, GPT, Kimi).
The author primarily wants to know which US or European conferences are suitable for a "Construction AI + benchmark" paper.
More from Research
- LLM leaderboards are now often measuring the harness too, Gary Marcus warns — GaryMarcus · 2026-07-22
- New paper defines self-state attacks, showing OS defenses leave four agent-memory cases indistinguishable — Justgototheeffinmoon · 2026-07-22
- Krea 2 users recommend a two-pass Clownshark sampler setup for sharper image details — listopalafoto · 2026-07-22
- Animation shows how an MLP’s first-layer weights change while learning MNIST — CatAstro_Piyush · 2026-07-22
- Project APE finds verifier reliability drops when papers contain multiple errors — soumitrashukla9 · 2026-07-22
- Project APE says verifier costs fell about 90x in a year as Chinese open models lead — soumitrashukla9 · 2026-07-22