Lakshya

LLM Systems Engineering · Chapter 20 of 20

Enterprise agent platforms

The thing banks are building — where business users describe a process and get an agent — what it is architecturally, and why most pilots do not reach production.

10 min read2 diagramsAll 20 chapters

A pattern that appeared in large enterprises very quickly: a central place where a business user describes a process they want automated, and gets a working agent — without going through a twelve-month project.

This chapter is about the platform underneath that promise. Building an agent covers one agent; this is what changes when there are three hundred of them and a regulator.

Architecturally, it is three planes

THREE PLANES — AND THEY ARE THE SAME THREE YOU ALREADY RUN FOR APIs REGISTRYthe catalogue plane• Which agents exist at all• What each one does• Who owns it• Who is allowed to call it• Which version is currentIDENTITYwho the agent IS• A workload identity, not a•   shared service account• On-behalf-of the asking user• Credentials it can and•   cannot holdGATEWAYenforcement at runtime• Authentication on every call• Rate limits and quotas• Routing to models and tools• One audit log• Cost attribution per agent The registry knows what should be true. The gateway makes it true. A registry with no gateway is a spreadsheet. IF THAT LOOKS FAMILIAR, IT SHOULD. It is an API catalogue, a workload identity, and an API gateway — the machinery most enterprises already run. What is genuinely new is session awareness (an agent’s call is one step in a longer task) and agent-to-agent routing. THE PLANE ALMOST EVERYONE SKIPS IS THE REGISTRY — because it produces nothing on its own. You cannot govern, cost, deprecate or incident-manage a population of agents you cannot enumerate. And by the time you want the list, there are three hundred of them and nobody remembers who built the first forty.
The red box is the one that decides whether you have a platform or a collection.

The registry and the gateway are not the same thing, and the distinction is load-bearing

The registry is the source of record: which agents exist, what they do, who owns them, who may call them, which version is live.

The gateway enforces that at runtime. Every call authenticated, rate-limited, routed, logged and costed.

A registry with no gateway is a spreadsheet that describes intentions. A gateway with no registry enforces rules nobody can see or review. You need both, and teams reliably build the second first because it does something visible.

The reassuring part, and it is worth saying to a nervous architecture board: a catalogue, a workload identity and a gateway are the machinery you already run for APIs. This is not a new discipline — it is an existing one pointed at a new consumer. What is genuinely new is session awareness (one call is a step inside a longer task, so per-call authorisation is not the whole story) and agent-to-agent routing.

What a business user actually meets

The interface that makes the promise real is usually a low-code builder — describe the process, pick the systems, set the guardrails — with a pro-code path underneath for anything it cannot express. Microsoft's version of this is Copilot Studio; Google, ServiceNow, Salesforce, Automation Anywhere and a set of specialists all sell the same shape.

“I WANT AN AGENT THAT DOES X” — WHAT SHOULD HAPPEN NEXT 1. Is the process written down and stable?If no → fix the process first. An agent on a broken process automates the mess, faster.2. Can a machine tell whether it worked?If no → you cannot operate it, only hope. Define this BEFORE anyone builds anything.3. Does it need judgement, or just steps?Just steps → that is a workflow tool, and it will be cheaper and more reliable.4. What happens when it gets it wrong?Reversible → go. Irreversible → gate it. Nobody knows → you are not ready.5. Who owns it in six months?No name → do not build it. This is the question nobody asks, and the one that decides. Question 3 disqualifies most requests — and that is the platform working, not failing. A deterministic process with known steps does not need a model in it. Good platforms route those AWAY from agents. A platform that says yes to everything is a queue for disappointment with a chatbot on the front.
The green box is the counter-intuitive part, and it is the difference between a platform and an order-taking service.

Question 3 does most of the work. A large share of requests that arrive as ‘we want an agent’ are deterministic processes with known steps, and those are cheaper, faster and more reliable as ordinary workflow automation. A platform team that routes those away from agents is doing its job; one that builds an agent for every request is manufacturing future maintenance.

Does it work? The evidence, handled carefully

The headline figure circulating in 2026 is that roughly 85 to 90% of enterprise agent pilots do not reach production.

Treat the precise number with caution. It is attributed variously to McKinsey, Gartner and others, and I could not reach a primary source for any of the specific figures — they recur across secondary coverage that cites each other. Given how often this session has found a confident statistic that dissolves on checking, assume the exact percentage is softer than it reads.

What is consistent across every version of it, and is the part that matters: the failures cluster on governance and observability, not on model capability. The recurring causes named are pilots built as demos with no agreed definition of good enough, governance brought in after the fact, agents attached to broken processes, and no named owner after launch.

Every one of those is a management failure with a technical costume, and none of them is fixed by a better model. That shape is far more useful than the percentage.

The same coverage reports that only a small minority of organisations can produce a current inventory of their agents at all. Whatever the exact figure, the direction is the registry argument above: the plane that produces nothing on its own is the one whose absence you discover at the worst possible moment.

Agent sprawl, and why it arrives faster than application sprawl

The economics are different from anything before it. A new internal application takes a team and a quarter. An agent takes an afternoon and a business user — which is the entire value proposition, and also the reason the population grows faster than any governance process designed for applications.

  • Default-deny agent creation, then delegate deliberately. Most platforms default to letting everyone build. Deciding that consciously is different from inheriting it.
  • An owner is a required field, and it is a person. Ownerless agents are the single most common artefact in a two-year-old platform, and nobody will volunteer to adopt one.
  • An expiry date, with renewal. An agent nobody has renewed in a year is almost certainly not being used and is certainly not being watched.
  • Cost attributed to a team from day one, not to a line item called ‘AI’. You cannot make a decision about a bill you cannot decompose — the same point as the cost chapter.
  • One audit log, holding the prompt, the retrieved context, the tools called and the outcome. This is what makes an incident investigable and an auditor answerable, and it is a schema decision made at the start or not at all.

In a bank specifically

  • The agent acts with its own permissions, not the asker's — so an agent with a broad service account hands its authority to anyone who can influence it, including a document it reads. On-behalf-of identity is the correct default and it is more work. See where agent risk concentrates.
  • Separation of duties survives automation. An agent that can both raise and approve a change is a control failure regardless of how good it is. The same check that runs on a human access request should run on an agent's.
  • Reversibility decides the gate, not importance. Reads free, reversible writes automatic, anything that moves money or touches a customer record gated with the arguments shown — not the intent.
  • Model risk management already applies. Most regulated institutions have a model governance function that predates all of this, and the fastest route through is usually to bring agents under it rather than to argue for an exemption.
  • Retrieved content is untrusted input. A document containing instructions is an attack, and in a bank the corpus contains things customers wrote. See prompt injection.

If you were asked to start one

  • Pick one process, end to end, with a named business owner and a machine-checkable outcome. Not a platform. One process. The platform is what you extract from the second and third.
  • Build the registry before the second agent, while it is a small file rather than an archaeology project.
  • Put the gateway in the path from the start. Retrofitting it means changing every agent that already works, and that project never gets scheduled.
  • Instrument the thing you will be asked about: how many agents, owned by whom, called how often, costing what, failing how. You will be asked in month four, and the answer ‘we don't have that’ is the one that ends the funding.
  • And write down what the platform will refuse to build. A platform with no refusal criteria becomes a ticket queue with a chatbot on the front.

The one-sentence version: an enterprise agent platform is a registry, an identity model and a gateway — the machinery you already run for APIs, plus session awareness — and the pilots that fail overwhelmingly fail on governance, ownership and the absence of a definition of done rather than on the models; so build the registry early, put the gateway in the path from the first agent, and let the platform say no to the requests that are really workflow automation.

Check yourself

What are the three planes?Registry (which agents exist, who owns them, who may call them), identity (a workload identity, on-behalf-of the user), and gateway (enforcement at runtime — auth, limits, routing, logging, cost).
What is the difference between registry and gateway?The registry knows what should be true; the gateway makes it true. A registry with no gateway is a spreadsheet of intentions; a gateway with no registry enforces rules nobody can review.
Why is this reassuring architecturally?It is a catalogue, a workload identity and a gateway — the machinery most enterprises already run for APIs. What is new is session awareness and agent-to-agent routing.
Which plane gets skipped, and why does it matter?The registry, because it produces nothing on its own. You cannot govern, cost, deprecate or investigate a population of agents you cannot enumerate.
What should happen when a business user asks for an agent?Five questions: is the process stable, can a machine verify it, does it need judgement or just steps, what happens when it is wrong, and who owns it in six months.
Which question disqualifies most requests?Whether it needs judgement or just steps. Deterministic processes are cheaper and more reliable as ordinary workflow automation, and routing them away is the platform working.
What does the pilot failure evidence actually say?The widely quoted 85–90% figure could not be traced to a primary source. What is consistent is that failures cluster on governance and observability rather than model capability — demos with no definition of done, late governance, broken underlying processes, and no named owner.
Why does agent sprawl arrive faster than application sprawl?An application takes a team and a quarter; an agent takes an afternoon and a business user. That is the value proposition and the reason the population outgrows governance built for applications.
What is the banking-specific risk?The agent acts with its own permissions, not the asker's — so a broad service account hands its authority to anyone who can influence it, including a document it reads.
← Loop engineeringPractice bank →