←Back/Engineering/Jev/Codex
IntermediateEngineering

How to Analyze GitHub PRs to Understand Engineering Effort with AI

Use the Jev AI model to cheaply and quickly cluster thousands of GitHub pull requests into thematic areas. This helps engineering and product leaders understand the breakdown of work between new features, tech debt, and maintenance.

Try this with your AI assistant

Download the skill for this workflow. Version 1.0.1.

Download skill
How to Analyze GitHub PRs to Understand Engineering Effort with AI

Before you start

Tools used

  • Jev

    TypeSafe AI’s model for fast structured decisions, including choices, scores, and boolean probabilities.

    VisitJev
  • Codex

    OpenAI's cloud-based AI software engineering agent that can execute code, run tests, and handle complex multi-file tasks autonomously.

    VisitCodex
  • Gemini

    Google AI assistant

    VisitGemini

The workflow

Follow the sequence once, then adapt the prompts, checks, and handoffs to your own setup.

3 steps

Step 01

Pull PR Data

Connect to the GitHub API and pull every single pull request from a specific repository that you want to analyze.

Step 02

Cluster PRs with Jev

Use Jev to compare candidate pairs of PRs and judge whether they address the same theme. Group related PRs using those results. For larger repositories, narrow the candidate pairs first so you do not need to compare every possible pair.

Example prompt
Are you working on the same thematic area or not?

This pairwise comparison method is highly effective for clustering related items without needing predefined categories.

Step 03

Label the Clusters

Once the PRs are grouped into clusters, use a cheap and fast large language model (like Gemini Flash Lite) to examine the PRs in each cluster and assign a descriptive label (e.g., 'Infrastructure', 'New Feature', 'Bug Fixes').

Build your next product with ChatPRD

Turn an idea into a PRD, user stories, and a plan.

Try ChatPRD free

Start shipping better products.

Join 250,000+ product managers who use ChatPRD to write better docs, align teams faster, and build products users love.

Free to start · 14-day Pro trial · SOC 2 Type II