Questioning OpenAI's Decisions API: are cloud round-trip latency and privacy viable in production?

WhichCardiologist800 · reddit · 2026-10-14

The author argues OpenAI's new Decisions API — replacing fragile prompt chains with structured AI decision-making — is the logical next step for agents, but raises two production concerns: sequential decisions in an agent loop compound delay with every network hop, making cloud-based real-time routing questionable; and data privacy remains unresolved. They ask whether real-time decision routing belongs in the cloud or strictly on-device/at the edge, and whether anyone has tested or benchmarked it.

Original post →

More from coding & agent

coding & agent channel →