Paper Debate: When Does Metric Dependence Emerge
KordingLab · x · 2026-07-15
This reply centers on a claim made on page 4 of a paper: the author believes the conclusion is mathematically sound, provided certain conditions are met—specifically, the task is sufficiently difficult, non-linearity is visible within the task, and a minimal/generalized solution is applied to these hard tasks.
The reply further emphasizes that the value of the related theorems lies in clarifying "why and when this metric dependence emerges," rather than offering broad empirical judgments.
Related event: Debate Sparks Over Metric Dependence in AI Research(4 posts)→
More from Research
- Structural ensembles beat single predictions in TCR:pMHC generalization study — quaidmorris · 2026-07-22
- Structural ensembles, not single predictions, drive robust TCR:pMHC generalization — quaidmorris · 2026-07-22
- A 3D ray plot shows how hard this Jacobian counterexample is to read — moultano · 2026-07-22
- LLM leaderboards are now often measuring the harness too, Gary Marcus warns — GaryMarcus · 2026-07-22
- New paper defines self-state attacks, showing OS defenses leave four agent-memory cases indistinguishable — Justgototheeffinmoon · 2026-07-22
- Krea 2 users recommend a two-pass Clownshark sampler setup for sharper image details — listopalafoto · 2026-07-22