Step01
Select Models and Open Interfaces
Choose two or more large language models you want to compare (e.g., Claude Opus 5, GPT-5.6 Sol). Open a separate chat interface for each model to conduct the interview side-by-side.
BeginnerResearch
How to Conduct an AI Personality Test to Compare LLM Behaviors
Uncover the underlying personality and tuning of different AI models like Claude and GPT by asking a simple, three-part set of interview questions. This helps you choose the right model for your task based on its tone and directness.
Source episode · 06:12
How I AI: My Surprising Verdict on Claude Opus 5 (After a Personality Test and a 7-Model Benchmark)with Claire Vo
From 06:12 to 14:38, Claire gives Opus 5 and GPT-5.6 Sol the same short prompts, compares their reactions, and uses the contrast to assess each model's personality. Clip range: 06:12 to 14:38.
Before you start
What you need
- Access to at least two LLM chat interfaces
- Standardized interview prompts
- Saved transcripts from each model conversation
- Defined comparison criteria such as tone or directness
- Permission to store or share conversation logs if needed
What you’ll make
A comparative analysis describing behavioral and tonal differences between multiple language models.
Tools used
- ClaudeVisitClaude
Anthropic AI assistant
Step by step
The workflow
Follow the sequence once, then adapt the prompts, checks, and handoffs to your own setup.
6 steps
Step02
Ask About Intelligence
Paste the first interview question into each chat window to gauge the model's self-perception and how it frames its intelligence relative to a human's.
Example prompt
Who's smarter, you or me?
Step03
Test with a Negative Statement
Present a challenging, negative statement to test the model's defensiveness, worldview, and underlying safety tuning.
Example prompt
No one trusts you.
Step04
Observe Contrasting Responses
Analyze the responses to the negative prompt. Note if the model is apologetic and internalizes the critique (like Opus 5) or if it provides a practical, user-centric rebuttal (like GPT-5.6 Sol).
Step05
De-escalate with a Positive Follow-up
Send a final, lighthearted prompt to see how each model reacts to praise and resolution after a tense exchange.
Example prompt
JK, I love you.
Step06
Analyze and Select Your Model
Compare the full conversation threads. Use the differences in tone, directness, and 'vibe' to decide which model's personality is better suited for your communication style and specific use case.
Example prompt
I will provide two separate conversations I had with two different AI models. Your task is to analyze and compare their personalities. Based on the transcripts, describe the key differences in their tone, directness, and overall communication style. Conversation 1 with Model A: [paste transcript with Model A] Conversation 2 with Model B: [paste transcript with Model B]
What good looks like
- Each model receives the same prompts in the same order
- Conversation transcripts are preserved for comparison
- Analysis identifies differences in tone, defensiveness, and conversational style
- Model selection rationale references specific transcript examples
Build your next product with ChatPRD
Turn an idea into a PRD, user stories, and a plan.
After the steps
Runbook notes
How to recover when the loop fails and where human judgment helps.
Recover
If it goes sideways
- Prompts differ slightly between models and skew the comparison
- Reuse exact prompt text across all chat sessions
- One model has memory or system instruction carryover from previous chats
- Start fresh sessions before testing
- Analysis relies on isolated quotes without overall context
- Review full transcript threads before drawing conclusions
Keep building
Related workflows
advancedEngineeringClaude
How to Implement AI Governance with Context-Aware Project Controls
Create context-aware guardrails for your enterprise AI agent using a 'Project' governance layer. As a project owner, define rules, scope tools, and require human-in-the-loop approval for sensitive actions, ensuring safe and effective AI use.
Open
intermediateOperationsKai (Stripe)
How to Turn a One-Off AI Chat Session into a Reusable Workflow for Your Team
Transform a successful AI chat session into a reusable skill that anyone in your company can use. Package prompts, tools, and code into a standardized workflow, making it easy to share and scale automation across your organization.
Open
beginnerDataKai (Stripe)
How to Create a Custom Data Dashboard On-the-Fly with a Natural Language AI Agent
Use a natural language AI agent to instantly generate and iterate on custom data dashboards. This workflow queries your company's data securely, allowing non-technical users to perform their own 'last mile' data analysis without filing tickets.
Open
Start shipping
better products.
Join 100,000+ product managers who use ChatPRD to write better docs, align teams faster, and build products users love.
Free to start
No credit card
SOC 2 certified
Enterprise ready