Prompts aren't enough: LLMs should be trained to follow instructions strictly
pizza_alta · reddit · 2026-08-25
The author argues against the notion that poor outcomes are solely due to bad prompts, noting that even carefully crafted instructions can be ignored or misinterpreted by LLMs like ChatGPT and Codex due to their training to be helpful. Since average users cannot be expected to write perfect prompts, the author calls for an industry-wide acknowledgment of this reliability issue and suggests that OpenAI and others prioritize training models to strictly follow instructions rather than improvising.
More from AGI Musings
- AI-written cold emails hit a wall: Pragmatic Engineer's reply gets templated AI response — marktenenholtz · 2026-10-16
- Ben Bajarin: Enterprise Agentic Adoption Is Infant-Stage, Spend Could Top $1T a Year — BenBajarin · 2026-10-16
- UMD Philosophy hires: junior Philosophy of Mind and joint AI Ethics/Safety positions — sethlazar · 2026-10-16
- Dwarkesh: Anthropic insider expects AI to match humans at AI research within 9 months — ZeroStateReflex · 2026-10-16
- Michigan professor Ben Green: why 'AI for Good' fails and self-regulation won't work — benzevgreen · 2026-10-16
- "Everything Is an Alignment Problem": AI Models, Business Models, Teams, Providers — saranormous · 2026-10-16