Agentic AI
Agentic AI consulting: what is deliverable and what is still a demo
Digiton builds and governs agentic systems for enterprises in Europe. An agent that plans steps and calls your systems ships today. An agent trusted with an irreversible action does not.
What an agent deployment actually contains
The model is the smallest part of it. An agent that survives contact with a real business is mostly the scaffolding around the model, and that scaffolding is where the work and the cost sit.
- Tools, with narrow contracts. Each action the agent can take, defined as a function with typed inputs, a validation step and a documented failure. An agent with broad database access has no tool layer, it has a security incident waiting for a busy week.
- State the agent can read and a memory it cannot silently rewrite. What it remembers between runs, where that lives, and how a person deletes a record from it.
- A plan the agent commits to before acting. Written down, reviewable, and comparable against what it then did.
- Evaluation cases, each with the agreed correct answer. Not sample outputs. Cases, with a score you can rerun after every change.
- The control layer. Permissions, approval gates, logging and a kill switch. That is the next section, because it is the half most proposals leave out.
The control layer
Four controls. Each one costs a day or two to build and saves the deployment.
- Permissions, scoped per tool and per agent. The agent gets its own service account with its own least-privilege grants, never a human's credentials. When something goes wrong you want the audit trail to name the agent.
- An approval gate on anything irreversible. Sending an external message, moving money, changing a customer record, deleting anything. The gate is a person, and the interface shows them the plan and the inputs rather than a yes or no button.
- Logging that reconstructs a decision. Input, retrieved context, the plan, every tool call with its arguments and result, and the final action. Article 26(6) of Regulation (EU) 2024/1689 sets a six-month floor for deployers of high-risk systems. The real reason to build it is that without the tool arguments you cannot explain a bad action three weeks later.
- A kill switch a duty manager can reach. One control that suspends the agent without a deployment, owned by operations rather than by engineering, tested before go-live rather than during the first incident.
Article 26(2) puts human oversight on deployers of high-risk systems, and requires that the people assigned to it have the competence, training and authority to exercise it. Authority is the word buyers skip. An oversight role that cannot stop the system is a review, not oversight.
Where agents beat workflow automation, and where they lose to it
This is the most expensive decision in the whole category, and it gets made on fashion rather than on shape.
| Use an agent when | Use deterministic automation when |
|---|---|
| The input is unstructured and varies. Email, documents, chat, mixed-format files. | The input has a schema and the branches are known. |
| The path changes per case and enumerating the branches would take longer than the work saved. | The same five steps run every time. |
| A judgement call is genuinely needed, and a human reviews the output anyway. | The rule is written down somewhere already. Encode the rule. |
| Volume is moderate and each case carries real value. | Volume is high and per-case value is small. Model cost per case then decides the business case. |
The common mistake runs one way. A team builds an agent for a task that had five branches, then spends a quarter constraining it back into those five branches. Reach for the agent when the branching is the problem.
The failure modes that show up in month two
Month one goes well in almost every deployment. These are the four that arrive later, and each has a control that prevents it.
Silent drift after a model or prompt change. Quality moves and nobody notices because there is no evaluation set to rerun. The fix is the evaluation set, built before the first release rather than after the first complaint.
Cost that scales with retries. A failing tool call sends the agent into a loop, and the bill arrives a month later. Caps per run, per day and per agent, plus an alert on retry rate.
Scope creep by tool. Someone adds a tool because it was easy, and the agent now has a capability nobody classified. Tool additions belong in change control and trigger a reclassification.
Oversight fatigue. The approval gate works, the reviewer approves 200 of 200, and by week six the gate is a rubber stamp. Sample the approvals, measure the override rate, and if it stays at zero the gate is on the wrong action.
What to pilot first
Pick a task with four properties and the first deployment tends to land. High volume of unstructured input, an existing human reviewer, a reversible action, and an owner who wants it.
Inbound document triage fits all four in most businesses. So does first-pass supplier or contract review, and internal knowledge retrieval where every answer carries its citation. Each has a person already doing the work, which gives you both the evaluation set and the reviewer.
What to avoid first: anything customer-facing with an irreversible action, anything touching a decision that falls under Annex III of Regulation (EU) 2024/1689, and anything where the current process is undocumented. The third one looks like the easiest win on the slide and it is the one that stalls, because there is no agreed correct answer to build against.
Digiton builds the agent and the control layer in the same engagement, and average deployment is 45 days from signed scope to a system running in production with the oversight step in it.
Frequently asked questions
What is agentic AI consulting?
It is the work of deciding which tasks justify an agent rather than deterministic automation, building the agent with narrow tool contracts and an evaluation set, and building the control layer around it: scoped permissions, approval gates on irreversible actions, logging that reconstructs a decision, and a kill switch operations can reach.
When should we use an agent instead of workflow automation?
When the input is unstructured and varies, the path changes per case, a judgement call is genuinely needed and a human reviews the output anyway. When the input has a schema and the same steps run every time, encode the rule. It is cheaper, faster and easier to explain.
What controls does an enterprise agent need?
Four. Permissions scoped per tool and per agent, on the agent's own service account. An approval gate on anything irreversible. Logging that captures input, retrieved context, the plan, every tool call with arguments and results, and the final action. A kill switch owned by operations and tested before go-live.
Can an agent be trusted to act without human approval?
For reversible actions inside a narrow tool contract, yes, once the evaluation set holds a score you accept. For anything irreversible, an approval gate stays. The useful question is which specific actions are reversible, and that is answered per tool rather than per agent.
What usually goes wrong after the first month?
Four things. Silent quality drift after a model or prompt change with no evaluation set to rerun. Cost that scales with retry loops. New tools added outside change control, so the agent gains a capability nobody classified. Oversight fatigue, where the reviewer approves everything and the gate becomes a rubber stamp.
What is a good first agent to pilot?
A task with high volume of unstructured input, an existing human reviewer, a reversible action and an owner who wants it. Inbound document triage, first-pass contract or supplier review, and internal knowledge retrieval where every answer carries a citation all fit. Avoid anything customer-facing with an irreversible action.
Related
Ready to put AI to work?
Book a discovery call and we will map the highest-value AI agents and automations for your business.
Book a discovery call