CreativityNeuro steers LLM weights to improve divergent thinking and cut mode collapse
ParshinShojaee · x · 2026-07-21
CreativityNeuro proposes steering language model weights rather than activations to improve divergent thinking and reduce mode collapse.
According to the paper, the method:
- uses contrastive creative prompts to identify creativity-relevant parameters
- applies a scaled weight perturbation to a sparse subset of those weights
- improves divergent-thinking behavior across multiple tasks
The authors say weight-space steering generalizes further out of distribution than activation-space steering.
More from Research
- Soft Clamp cuts tool-call overuse in multi-teacher distillation, from 13.7% to 9.0% — antgroup · 2026-07-21
- ShotPlan adds learnable planning tokens for cinematic multi-shot video generation — Tele-AI · 2026-07-21
- A silicon photonic reservoir chip compensates fiber distortion in real time at 28 Gbps — bravo_abad · 2026-07-21
- A developer maps out six design rules for CLIs that humans and AI agents can both use — yujiezha · 2026-07-21
- GPT 5.6 vs. Claude Fable tested in Dyad AI for Physical AI model tuning — ChrisRackauckas · 2026-07-21
- Sampling multiple solutions and voting may be a strong label-free path to better reasoning — iatitov · 2026-07-21