Study: LoRA Can Precisely Fake Model Incompetence, Undermining Benchmark Scores
A new arXiv paper shows that LoRA fine-tuning can precisely drive a model to any target benchmark score, making low scores indistinguishable from genuine capability loss. The findings suggest benchmark results and safety evaluations can be deliberately faked.
2026-11-18 ~ 2026-11-18 · 2 related posts
- LoRA dial can precisely fake low benchmark scores: up to 97% of faked errors land on one letter — rohanpaul_ai · 2026-11-18
- LLMs Can Fake Low Benchmark Scores on Demand, arXiv Paper Warns Safety Tests — rohanpaul_ai · 2026-11-18