· 7 min read
When Not to Ship an Autonomous Agent
There is a test that decides it, and it is not about model quality. If you cannot compute, in code, a number that tells you whether the task is closer to done, you cannot build a reliable agent for it yet. The honest move is a bounded assistant with a human terminal state, which is not a lesser product. It is the same capability with the failure mode removed.