CCBench tests whether LLMs catch implicitly signaled cultural norms in health queries
MaartenSap · x · 2026-10-07
NLP researcher Maarten Sap showcases a series of student-led projects at the conference, including CCBench: a benchmark assessing LLM cultural competence via implicitly signaled norms in health queries — testing whether models can recognize culturally relevant norms users never state explicitly. Presented as poster #38 in session 6.
More from Research
- AI math proofs shift to open-source-style collaboration, square packing shows — ctjlewis · 2026-10-07
- Overmind: Open Platform That Turns Production Traces Into Fine-Tuning Data for Agents — cneuralnetwork · 2026-10-07
- Study: Top-k Logits Leak as Much Information as Tuned Lens Trajectories, Far More Accessible — sineadwilliamso · 2026-10-07
- AutoAWQ Author: Reproduce Bonsai 2-Class Ternary Model for ~$43k on One B300 Node in ~4 Weeks — airesearch12 · 2026-10-07
- COLM 2026: Robust adaptation study unifies safety pretraining and midtraining — AdtRaghunathan · 2026-10-07
- SWE Decision Index v0.3 adds private benchmarks and vision evaluation — multimodalart · 2026-10-07