Executive Decision · AI and Enterprise Control

What Should Remain Human?

The objective is to place human judgement where the consequences justify it.

Devendra KumarOctober 20262 min read

AI agents are moving from generating recommendations to taking actions.

The executive question is not whether an agent should be autonomous.

The question is:

Which decisions and actions should remain human-controlled?

Start with the consequences.

An action with low risk and easy reversal is a stronger candidate for autonomy.

An action involving customers, money, regulation, reputation or irreversible outcomes needs stronger human control.

Use six questions:

  1. 01What happens if the agent is wrong?
  2. 02How quickly will the error be detected?
  3. 03Can the action be reversed?
  4. 04Who is accountable for the outcome?
  5. 05What limits prevent the agent from exceeding its authority?
  6. 06Who can stop the agent?

Then place the activity on an autonomy ladder:

Observe → Recommend → Draft → Execute with approval → Execute within limits → Fully autonomous

Do not start with maximum autonomy.

Start with the lowest level that creates meaningful value.

Increase autonomy only when evidence supports the change.

The objective is not to remove humans from the process.

The objective is to place human judgement where the consequences justify it.

TopicsAIGovernanceExecutive Decision-Making

Related

Read next.

Explore more perspectives →