← Back to essays
·2 min read·By Ry Walker

The Mesh, Not the Monolith

The Mesh, Not the Monolith

There is a temptation to build one mega-agent that handles everything. I have played with tools that let you spin up an entire org chart of agents — a CEO agent delegates to a CTO agent which spins up frontend and backend developers in parallel. Exhilarating to watch. Also chaos.

Enterprise wants controlled, reviewable, auditable execution. The model that works is a mesh of specialized agents, each handling a specific domain, coordinated by human pilots who make the judgment calls. A coding agent generates the service. An infrastructure agent deploys it. An observability agent configures monitoring. An investigation agent handles incidents. Each one is real software — tested, versioned, production-grade — not a prompt chain.

This pattern is already visible at the top of the market. The largest engineering organizations are building multi-agent systems where their internal agents communicate with the agents their vendor platforms ship — Datadog, ServiceNow, Incident.io. As one lead engineer put it: "We have agents that then talk to their agents." This is completely unreplicable for a 25-person company, or a 200-person company.

The lesson is not that everyone should build their own orchestration platform. The lesson is that the pattern they are proving — agents embedded in existing workflows, triggered by non-technical users, producing reviewable output — is exactly what needs to be productized for everyone else. I've made the related case that pooled, role-based agent capacity is the unit of AI consumption now, and the mesh is what that capacity gets spent on.

Pick your domains. Build small, specialized agents. Let humans pilot the coordination until the patterns are stable. The mesh is the architecture that survives the next five years.

Key takeaways

  • The mega-agent fantasy is exhilarating in demos and chaotic in production. Enterprise wants a mesh.
  • Each agent in the mesh is real software — tested, versioned, production-grade — not a prompt chain.
  • The pattern at the top of the market is "our agents talk to their agents." The lesson is not to build orchestration platforms. The lesson is to productize the pattern.

FAQ

What does a mesh of agents actually look like?

A coding agent generates a service. An infrastructure agent deploys it. An observability agent configures monitoring. An investigation agent handles incidents. Each is real software, coordinated by human pilots who make the judgment calls.

Why not build one mega-agent that does everything?

Because enterprise wants controlled, reviewable, auditable execution. A CEO-agent delegating to a CTO-agent that spins up frontend and backend developers in parallel is fun to watch and impossible to audit when something goes wrong.