Season's Savings | ₹5/mo for 3 months

₹199/month after first 3 months. Renews automatically. Terms apply.
The Infrastructure Behind Agents That Run for Months cover art

The Infrastructure Behind Agents That Run for Months

The Infrastructure Behind Agents That Run for Months

Listen for free

View show details
About this listen
Tony Holdstock-Brown is the CEO and co-founder of Inngest, which built durable workflows for background jobs before the agent wave arrived. He says most Inngest customers no longer log into the UI. Their agents check on what they have built through the API, the CLI and MCP, and people who build with agents activate at about 93 percent, against roughly 40 percent before.Holdstock-Brown defines a long-running agent as one that lives for months and builds up its own context. Running one means orchestrating sub-agents, sandboxes and state for every customer, and he argues that orchestration layer becomes the product. He and Conor Bronsdon also get into why agent load compounds, how to score an agent from production events, and what Inngest learned from running out of compute.If your users never open your product themselves, how it behaves for their agents is the whole experience.We cover:Why durable workflows, a series of steps with checkpoints, mapped cleanly onto agentsHoldstock-Brown's definition of a long-running agent: it lives for months and builds its own contextInngest's shift from UI traffic to API, CLI and MCP, and the 93 percent activation rate among people building with agentsHow agent load compounds when every user's agent makes thousands of API requests a dayTracking events and outcomes for every agent run, a lesson Holdstock-Brown ties to KISSmetrics and A/B testingExplicit step APIs compared with compiler directives, and why a step is close to tracingRunning out of compute: bare metal, bandwidth limits and building on FoundationDBNew episodes, the ideas behind them and Conor's essays land in the Chain of Thought newsletter first. Subscribe: https://newsletter.chainofthought.show/Chapters:(0:00) Why agents need durable infrastructure(1:13) How Inngest started before agents(3:55) Defining a long-running agent(6:10) Orchestration becomes the product(8:42) Customers' agents replace the UI(10:42) Reliability when agent load compounds(16:42) State, memory and personal agents(20:52) Personal agents for mainstream users(28:09) Step APIs vs compiler directives(31:29) Code review agents and security(40:40) Running out of compute(46:58) Building your first long-running agentLinks from the episode:How the Claude Code team does code review (Anthropic): https://claude.dev/blog/solving-code-review-at-anthropic/Claude Duet announcement: https://claude.com/resources/articles/claude-duetClean Code by Robert C. Martin: https://www.informit.com/store/clean-code-a-handbook-of-agile-software-craftsmanship-9780132350884Software Engineering is Dead. Long Live Product Engineering (Conor's essay): https://newsletter.chainofthought.show/p/software-engineering-is-dead-longOpenClaw: https://openclaw.aiChain of Thought with Claire Vo: How AI Velocity is Rewriting the Rules for Engineering Leaders: https://share.transistor.fm/s/5178eb0aChain of Thought with Jaime DeLanghe: Slack Wants to Be the Context Harness for Code: https://share.transistor.fm/s/274962beChain of Thought with Laurie Voss: AI Codes: Product Engineers Decide What to Build: https://share.transistor.fm/s/6deea963Chain of Thought with Wen Sang: Genspark's Bet: AI Agents Become the Users of Software: https://share.transistor.fm/s/c898a0e8Connect with Tony Holdstock-Brown:X: https://x.com/itstonyhbInngest: https://inngest.link/cot-podConnect with Chain of Thought host Conor Bronsdon:Newsletter: https://newsletter.chainofthought.show/Twitter/X: https://x.com/ConorBronsdonLinkedIn: https://www.linkedin.com/in/conorbronsdon/YouTube: https://www.youtube.com/@ConorBronsdonMore episodes: https://chainofthought.showThanks to Inngest, presenting sponsor of season four of Chain of Thought. Agents in production run long - they call models and wait on APIs and people. But the longer agents run, the more they break. Inngest handles that with durable execution. You build your agent as steps in TypeScript, Python, or Go. When a step fails, Inngest retries it with exponential backoff, and completed steps are saved and skipped. Try it out: https://inngest.link/cot-pod
adbl_web_anon_alc_button_suppression_t1
No reviews yet