←Back/Product/Cursor/Slack
AdvancedProduct

Build an Automated Growth Experiment Loop with Multiple AI Agents

Coordinate agents in Slack and Cursor to propose growth experiments for human review. Ezra’s Auto XP system was still being developed at the time of the episode.

Illustration of Build an Automated Growth Experiment Loop with Multiple AI Agents

One of the things you can do is just say, 'Hey, Auto XP, go find an experiment to run on our settings page. See what you can do. Go crazy.' And it will trigger a data scientist agent to go find drop-off and like look at the funnel... It will trigger a UX writing agent that will come up with some ideas for copy... Lastly, it'll trigger an engineer that'll pick up a PR and run it. And then again, with all of these steps, it writes back to the Slack channel in the same thread.

Before you start

What you need

  • A prompt in a dedicated Slack channel.
  • Access for agents to product analytics data, a codebase to create PRs against, and a design system or copy guidelines.

What you’ll make

A documented experiment proposal and draft implementation for human review.

Tools used

The workflow

Follow the sequence once, then adapt the prompts, checks, and handoffs to your own setup.

7 steps

Step 01

Set Up the Multi-Agent System

Create a dedicated Slack channel (e.g., #auto-xp). Using a tool like Cursor, configure three distinct agent automations: a 'data scientist', a 'UX writer', and an 'engineer'. Each agent should be configured to trigger the next and write its output into the same Slack thread.

This setup creates a transparent, observable workflow where a human can follow the experiment's entire lifecycle in one place.

Step 02

Initiate an Experiment Request

In the dedicated Slack channel, post a message to kick off the workflow. This can be a broad directive or a more targeted request.

Example prompt
"Hey, Auto XP, go find an experiment to run on our settings page. See what you can do. Go crazy."

This initial prompt triggers the first agent in the chain, the data scientist, to begin its analysis.

Step 03

Agent 1: Analyze and Hypothesize

The data scientist agent analyzes product data (e.g., funnels, drop-off) to find an opportunity. It then formulates a hypothesis and posts its findings to the Slack thread.

Check that the agent’s proposed opportunity is supported by the underlying data.

Step 04

Agent 2: Propose a Solution

Triggered by the data scientist's output, the UX writing agent (and potentially a design agent) proposes a specific change, such as new copy or a modified layout, and adds it to the thread.

This agent translates the data-driven opportunity into a concrete user-facing change.

Step 05

Agent 3: Implement the Change

The engineering agent takes the proposed solution and creates a pull request to implement the experiment. It posts a link to the PR in the Slack thread.

The PR keeps the implementation alongside the hypothesis for review.

Step 06

Human Review and Launch

A product manager reviews the entire Slack thread, which now contains the data, hypothesis, proposed solution, and code. If approved, the experiment is launched.

This is the most critical human checkpoint. The goal is to compress the work, not to abdicate responsibility for what gets shipped to users.

Step 07

Automate Analysis and Iteration

Configure a webhook to trigger an analysis agent when the experiment concludes. This agent should analyze the results and post a summary, then automatically kick off the next iteration based on the findings.

Review the analysis before choosing the next experiment; this loop was still being developed in the episode.

What good looks like

  • An agent successfully identifies a testable opportunity from data.
  • Agents for UX writing and engineering successfully generate a hypothesis and a working implementation.
  • The entire process is documented in a single Slack thread for human review.
  • A human reviews and approves the experiment, which is then launched.

Build your next product with ChatPRD

Turn an idea into a PRD, user stories, and a plan.

Try ChatPRD free

Runbook notes

How to recover when the loop fails and where human judgment helps.

If it goes sideways

The data scientist agent generates a weak or unsupported hypothesis, leading to a low-value experiment.
Improve the agent's instructions with more specific criteria for what constitutes a good opportunity (e.g., minimum traffic, drop-off rate thresholds). Ensure the human review gate is strictly enforced.
The engineering agent fails to create a valid pull request or introduces new bugs.
Provide the agent with more context about the codebase, including examples of well-structured PRs. Ensure automated tests are run against the agent's PR.

Human checkpoints

Let routine work keep moving.

  1. Before launch, a human must review the complete experiment package: the data science findings, the hypothesis, the UX writing, and the code.

Start shipping better products.

Join 250,000+ product managers who use ChatPRD to write better docs, align teams faster, and build products users love.

Free to start · 14-day Pro trial · SOC 2 Type II