Machine coworkers

Software agents that hold responsibilities — which turns them into a management problem (scope, approval, escalation, review) long before it is a technology problem.

The part that costs money

The moment an agent holds a responsibility rather than performing a task, every remaining question about it is a management question. What is it allowed to do on its own. Who approves the part that cannot be undone. What happens when it is wrong. Who finds out. None of those are model questions, and none of them are answered by picking a better model.

Companies are deploying agents into standing responsibilities with no written scope, no approval boundary and no review cadence. A human hired into that arrangement would be a governance incident within a month. The agent version passes without comment because the org chart has no row for it.

The failure asymmetry is what makes this urgent rather than tidy. A junior analyst who is unsure escalates, hedges, or asks. An agent that is unsure produces a fluent paragraph at the same confidence as everything else it has ever written. The organisation loses its most reliable early-warning signal — visible human hesitation — precisely where it is adding capacity fastest.

What it looks like

An agent has been reconciling invoices for six weeks and doing it well. Nobody in the company can currently say what it is permitted to write back, who approved the tolerance it applies, or what it did last Tuesday. It holds a responsibility and has no manager. The first time anyone will examine any of this is after it gets one wrong.

How you would actually measure this

What it is not

Related terms

Frequently asked questions

What are machine coworkers?

Software agents that hold responsibilities — which turns them into a management problem (scope, approval, escalation, review) long before it is a technology problem.

How do you manage AI agents in a company?

The same way you manage anyone holding a responsibility: a written scope, a named human owner, an explicit boundary around irreversible acts, and a review cadence with recorded outcomes. The difference is that an agent will not signal uncertainty on its own, so the review has to be scheduled rather than triggered by someone looking hesitant.

Do AI agents need performance reviews?

They need outcome review, which is the useful half of a performance review and none of the ritual. Pull what the agent decided or recommended over a period, check it against what actually happened, and change the scope or the thresholds accordingly. Rating an agent is theatre; scoring its calls is how you find out whether to widen or narrow what it is allowed to do.

Should an AI agent be allowed to act without a human?

For reversible acts, frequently — that is where the leverage is. For irreversible ones — a payment, an external send, a price change, a production mutation — no, and a system that removes that boundary has not become more autonomous, it has removed the only place accountability could sit.