How would you test whether an AI assistant's interruption is actually justified?

AlexWorkGuru · reddit · 2026-11-10

Reddit user AlexWorkGuru proposes a hypothetical eval for whether AI assistants should interrupt you: given 12 potentially noteworthy items across calendar, messages and notes, dumping them all just creates another inbox. His three-event scenario: a punctuation-only agenda edit should be ignored, a colleague's "client might move the deadline" stays an unresolved possibility, and only a confirmed impossible deadline should surface — with the original message and decision needed. Re-run the test after it's handled to check the assistant stops flagging, and measure unnecessary interruptions alongside missed changes.

Original post →

More from coding & agent

coding & agent channel →