←Back/Engineering/Jev/Codex
IntermediateEngineering

How to Analyze GitHub PRs to Understand Engineering Effort with AI

Use the Jev AI model to cheaply and quickly cluster thousands of GitHub pull requests into thematic areas. This helps engineering and product leaders understand the breakdown of work between new features, tech debt, and maintenance.

How to Analyze GitHub PRs to Understand Engineering Effort with AI

Before you start

Tools used

  • Jev

    TypeSafe AI’s model for fast structured decisions, including choices, scores, and boolean probabilities.

    VisitJev
  • Codex

    OpenAI's cloud-based AI software engineering agent that can execute code, run tests, and handle complex multi-file tasks autonomously.

    VisitCodex
  • Gemini

    Google AI assistant

    VisitGemini

Step by step

The workflow

Follow the sequence once, then adapt the prompts, checks, and handoffs to your own setup.

3 steps

Step01

Pull PR Data

Connect to the GitHub API and pull every single pull request from a specific repository that you want to analyze.

Step02

Cluster PRs with Jev

Use Jev to compare candidate pairs of PRs and judge whether they address the same theme. Group related PRs using those results. For larger repositories, narrow the candidate pairs first so you do not need to compare every possible pair.

Example prompt
Are you working on the same thematic area or not?

This pairwise comparison method is highly effective for clustering related items without needing predefined categories.

Step03

Label the Clusters

Once the PRs are grouped into clusters, use a cheap and fast large language model (like Gemini Flash Lite) to examine the PRs in each cluster and assign a descriptive label (e.g., 'Infrastructure', 'New Feature', 'Bug Fixes').

Build your next product with ChatPRD

Turn an idea into a PRD, user stories, and a plan.

Try ChatPRD free

Start shipping
better products.

Join 100,000+ product managers who use ChatPRD to write better docs, align teams faster, and build products users love.

Free to start
No credit card
SOC 2 certified
Enterprise ready