Back/Product/NotebookLM
BeginnerProduct

How to Use NotebookLM as an AI Judge for Product Pitches and Competitions

Use NotebookLM as a consistent additional judge by loading every pitch separately, applying an anchored rubric, and generating an evidence-linked ranking that complements human judges.

How to Use NotebookLM as an AI Judge for Product Pitches and Competitions

Marily uploads each demo-day pitch as a separate NotebookLM source, asks it to rank entries against innovation, impact, and storytelling, and presents the result through an interactive audio overview.

Before you start

What you need

  • A complete audio or transcript file for every eligible pitch
  • A disclosed scoring rubric with anchored criteria
  • NotebookLM and a source naming convention
  • Human judges and a tie or appeal process

What you’ll make

A criterion-level scorecard and entertaining audio summary that cites the pitches, exposes uncertainty, and supports rather than replaces the accountable judging decision.

Tools used

Step by step

The workflow

Follow the sequence once, then adapt the prompts, checks, and handoffs to your own setup.

3 steps

Step01

Set Up Your Sources in NotebookLM

Upload one clearly named audio or transcript source per eligible pitch and reconcile the NotebookLM source list with the competition roster before any scoring.

This method works with many source types, not just audio. You could upload pitch decks, business plans, or video transcripts as well.

Step02

Instruct NotebookLM to Act as a Judge

Give NotebookLM an anchored rubric with weights, evidence requirements, missing-evidence handling, and tie rules. Request a criterion table before requesting winners.

Example prompt
Evaluate every eligible pitch against this rubric: [criteria, anchors, and weights]. For each entry, cite specific source evidence, score each criterion, mark missing evidence, note uncertainty, and calculate the weighted total. Do not infer founder ability from accent, fluency, production quality, or demographic signals. Return ties where the evidence does not separate entries.

Be as specific as possible with your criteria. The more detailed your instructions, the more accurate and relevant the AI's analysis will be.

Step03

Generate and Present the AI's Verdict

Inspect the scorecard with human judges, correct source or scoring errors, resolve ties, and then generate an audio overview that explains the selected entries and criteria. Disclose that AI supplied an additional analysis and record the human-owned final decision.

Example prompt
Create a concise audio overview of the final results using the approved scorecard. Explain each selected entry’s evidence against the rubric, mention any close tie or uncertainty, and state that the final awards were confirmed by the judging panel.

Using the live radio show feature can be a fun and memorable way to conclude a hackathon or demo day, making the AI judge a part of the event itself.

What good looks like

  • Every eligible entry is present and evaluated against the same rubric.
  • Scores cite specific pitch evidence and distinguish missing evidence from weak performance.
  • Conflicts, ties, and source-quality problems are visible to human judges.
  • The final award process and use of AI are disclosed to participants.

Build your next product with ChatPRD

Turn an idea into a PRD, user stories, and a plan.

Try ChatPRD free

After the steps

Runbook notes

How to recover when the loop fails and where human judgment helps.

Recover

If it goes sideways

An upload fails or one pitch receives less usable audio
Reconcile the source inventory before scoring and use a transcript or replacement recording when needed.
Broad criteria produce confident but inconsistent rankings
Define anchored scoring levels, weights, disqualifiers, and tie handling before analysis.
Delivery style overwhelms product substance or accessibility differences
Score each criterion separately, avoid inferring capability from accent or fluency, and include the written submission when available.
The generated audio is treated as an unquestionable verdict
Give human judges the evidence table, let them resolve ties and errors, and record the final rationale separately.

Start shipping
better products.

Join 100,000+ product managers who use ChatPRD to write better docs, align teams faster, and build products users love.

Free to start
No credit card
SOC 2 certified
Enterprise ready