Build

Autonomy is a permission design, not a personality trait.

The useful question is not how independent the agent feels. It is which actions it may complete without a person, and what happens when it is wrong.

Adnan Boz
Adnan Boz

How I see it

Autonomous agents

In enterprise work, autonomy should be bounded. An agent can complete a routine refund under a threshold, update a record when confidence and checks pass, or assemble a packet and stop. It should not invent a new policy because the prompt sounded confident.

Companies get hurt when they treat autonomy as the product. They remove review to look advanced, then discover the expensive cases were the ones that needed judgment.

A better design increases autonomy only where the error cost is low, the evaluation is strong, and the rollback path is clear. High-risk actions stay supervised even if the model is capable.

For a COO, the win is completed volume with known risk, not a story about software that works like an employee.

Common mistakes

What teams usually get wrong.

01

Autonomy as a goal

Removing humans from a high-risk step to make the system look advanced is not operating leverage.

02

No stop conditions

An agent that can keep trying will spend money and create messes.

03

No rollback

If a bad write-back cannot be reversed or flagged, autonomy is too expensive.

A useful diagnostic

Five questions before you fund the work.

  1. What is the error cost of the action the agent would take alone?

    If the cost is high, autonomy is the wrong first setting.
  2. Is there a hard stop on retries, spend, and scope?

    Unbounded loops are an operations incident waiting to happen.
  3. Can a person reconstruct what the agent did?

    If not, you cannot defend the autonomy you granted.
  4. Is there a rollback or compensating action?

    No rollback means the autonomy boundary is too wide.
  5. Would you let a new hire do this unsupervised on week one?

    If not, do not let the agent do it unsupervised either.

Economic model

Autonomy boundary

allow unsupervised action only when error cost × failure rate is acceptable

If you cannot estimate either number, keep a human at that step.

Three credible paths

How far should you go?

Do not force one solution. Choose the path the economics, the risk, and the organization can support.

01

Supervised completion

The agent prepares and proposes. A person accepts the action.

Best when

Error cost is material or the evaluation set is still thin.

Limitation

Throughput is limited by reviewer capacity.

02

Bounded autonomy

The agent completes routine cases under thresholds and escalates the rest.

Best when

The common path is well measured and rollback exists.

Limitation

Thresholds need owners, or they quietly become the whole process.

03

Broader unsupervised action

Expand autonomy only after failure modes and cost are known in production.

Best when

The agent has a track record on real volume.

Limitation

This is rare as a starting point and should stay rare.

When this is the wrong next step

Do not fund an agent here.

  • The action cannot be undone and the company cannot absorb a public miss.
  • There is no evaluation and no logging.
  • Leadership wants autonomy for the story, not because the economics require it.
Adnan Boz

A useful next step

Bring one workflow. Get guided into production.

We guide the implementation, go deep on the technical path, and stay hands-on through operations — or tell you when a simpler answer is better.

Discuss an AI opportunity