"Be creative" prompts drift across agent models, checkable requirements don't

ClickOk5811 · reddit · 2026-10-04

A developer swapping the underlying model behind an agent's planning step found that "Be creative" in the reasoning prompt produced wildly varied, chaotic tool selection on one model but only a conservative nudge on another. The word does no fixed work: its effect is relative to each model's default behavior, so deterministic models read it as a bigger push while wander-prone models barely shift. What survives model swaps is anything stated as a checkable requirement — output schemas for tool calls, explicit tool eligibility constraints, defined fallbacks — because hard requirements aren't measured against a model's personal habits.

Original post →

More from coding & agent

coding & agent channel →