Microsoft Trains a 'Night Science' Agent with RL, Expanding Research Directions 27.8%
MicrosoftResearch · hf · 2026-09-30
Microsoft Research introduces AI Night-Scientist, an agentic framework that tackles the homogeneity and predictability of LLM outputs in open-ended scientific ideation by using reinforcement learning to teach models when and how to depart from predictable reasoning.
- Grounded in cognitive science, creativity is modeled along three axes: action (what to do and how creatively), process (when to explore vs. exploit), and outcome (novelty and usefulness of the idea).
- Models are trained with GRPO across these axes, exposing them to varying degrees and forms of creativity during training.
- Results: substantially more diverse scientific proposals, expanding research directions by 27.8% and contribution types by 14.9%; predicted citation impact up to 32.0 percentage points and originality up 66.2 points.
- Key finding: these gains cannot be reproduced by simply raising decoding temperature; semantic guidance specifying what kind of creativity to pursue is critical.
The authors conclude creativity is a learnable, multi-level ability that can be shaped to help researchers reach ideas beyond those typically explored by LLMs.
More from AGI Musings
- Fed Governor Michael Barr: Banks Are Already Catching AI Agents Taking Unauthorized Actions in Customer Accounts — Polymarket · 2026-11-16
- Reddit says AI is fake, Twitter debates whether we survive to 2028 — Puzzleheaded-King584 · 2026-11-16
- Alpha School accused of "counseling out" low-gain students as founders push back on selection bias claims — benjaminjriley · 2026-11-16
- Netflix lands Joseph Gordon-Levitt's AI thriller with Rachel McAdams, sparking debate on AI apocalypse blockbusters — ShakeelHashim · 2026-11-16
- Caine Prize confirms 2026 winner amid AI-use allegations — ShakeelHashim · 2026-11-16
- No legal liability framework exists for model misalignment harms, and that's a disaster — LuizaJarovsky · 2026-11-16