← Back to essays

Software Factories Run on Pre-Prod

·2 min read·By Ry Walker

Every impressive self-driving software factory demo has something in common: the software has no customers yet.

Autonomous agent loops are real and they are getting better fast. Chain a builder agent to a critic agent, have a third agent adjudicate, run it until everything resolves. I find this architecture genuinely exciting, and we are building toward it. But watch where these loops actually run today. They run on greenfield projects, internal tools, and pre-production code. Places where the blast radius of a bad merge is zero.

Now look at a typical engineering org. A thousand tickets in the backlog, a production system, paying customers on the other end of every deploy. You cannot point an autonomous loop at that backlog and let it rip. Not because the agents are not capable enough, but because the risk math does not work. One bad autonomous change in production costs more than a hundred good ones save. Teams with real customers know this in their bones, which is why the fully autonomous factory remains a spectator sport for most of them. It is fun to watch. It is not practical for their reality.

The pattern that does work in production is narrower and less cinematic. Context in, background execution, reviewable output, human approval. The loop can be as aggressive as you like right up until the merge decision, and then a human owns the yes or no. That gate is not a concession to weak models. It is what makes aggressive automation deployable at all, which is the argument I made in human review is not a limitation. The gap between the loop demo and the loop in production is the same gap that has always separated the demo from the deployment.

The factories will earn their way into production eventually, one workflow at a time, as trust accumulates. Until then, the practical question for a leadership team is not whether to run autonomous loops. It is where the approval gate sits, and who holds it.

Key takeaways

  • The fully autonomous agent loop demos are almost all running on pre-production software where the blast radius is zero.
  • A team with real customers cannot point agents at a thousand tickets and let them run, because the risk profile of production code forbids it.
  • The production-grade pattern is background execution with reviewable output and human approval, not unsupervised loops.

FAQ

Are autonomous agent loops useless for real engineering teams?

No, they are genuinely powerful. But today they belong in environments where the cost of a mistake is low, like greenfield and pre-production work. Production systems with real customers need a human approval gate.

What does a production-safe agent workflow look like?

Context goes in, the agent executes in the background, the output arrives in a reviewable form, and a human approves before anything ships. The loop can be as aggressive as you want up to that gate.

Tembo

Drowning in pull requests that need your review? Try Tembo Review, a beautiful AI-assisted PR review tool unlike anything you’ve used.