Mitchell Hashimoto explains why models get locked onto your examples instead of the task

mmitchell_ai · x · 2026-10-24

Chris Albon complained that communicating by examples makes AI models "lockjaw" onto them and stop thinking. Mitchell Hashimoto explained the mechanism: when your input supplies examples of ingredients rather than the recipe, the "recipe" token has no matching pattern, so the model tries to complete the output along the lines of the examples instead of addressing your actual ask. Hashimoto followed up with the workaround: restructure examples as a list the model must complete (one-shot / few-shot prompting).

Related event: AI engineers discuss why examples lock models down and how few-shot lists fix it(6 posts)→

Original post →

More from Apps

Apps channel →