Actively Recruiting
Artificial Intelligence Assessment of Trainee Communication Compared to Human Assessment: A Prospective Cohort Study
Led by Stanford University · Updated on 2026-04-24
45
Participants Needed
1
Research Sites
8 weeks
Total Duration
On this page
AI-Summary
What this Trial Is About
Researchers are evaluating a web-based artificial intelligence platform called Clinical Mind AI (CMAI) to assess communication skills in anesthesiology trainees such as residents and fellows. The study focuses on trainees' ability to disclose medical errors, using an AI-generated voice simulation involving a clinical case of a pediatric patient who suffered a dental injury during intubation. The goal is to compare AI assessments with human evaluations to determine reliability, usability, and satisfaction with this innovative training method. Participants will engage remotely with the AI platform through a voice call simulating a conversation with the parent of a pediatric patient. After the simulation, their communication skills will be evaluated by both the AI system and two human raters using the same standardized rating scales. The study will measure how well the AI assessment matches human assessment, as well as gather feedback on the platform's usability and trainee satisfaction. During the study, participants will complete the AI voice simulation and then fill out questionnaires on their experience. Assessments occur immediately after the simulation to capture performance reliability and user impressions. The study includes graduate medical trainees able to communicate in English and able to use the necessary technology. Participation involves remote interaction and evaluation, with the entire process designed to assess communication skill training in complex clinical conversations.
CONDITIONS
Brief Title
Use of Artificial Intelligence to Assess Trainee Communication Compared to Human Assessment
Who Can Participate
Eligibility Criteria
You may qualify if you...
- Participants must be 18 years of age or older
- Graduate medical trainees such as residents and fellows at all levels of training excluding PGY1 trainees in the Department of Anesthesiology, Perioperative, and Pain Medicine at Stanford University
- Able to speak and understand English
- Willing and able to provide consent to participate in research
- Able to participate in Artificial Intelligence communication simulation
You will not qualify if you...
- Non-English speakers
- Unable to provide consent to participate in research
- Individuals without access to the necessary technology (internet, computer or smart device) required for participating in the digital, voice-based interaction with the AI platform
AI-Screening
AI-Powered Screening
Complete this quick 3-step screening to check your eligibility
Your Study Journey
Duration - 2 to 4 weeks
Participants are screened for eligibility to participate in the trial.
1 visit (remote)
Duration - 1 day
Participants remotely engage in a voice-based AI simulation involving a clinical scenario with a simulated parent. Their communication skills are assessed by both the AI system and human evaluators using standardized rating scales immediately after the simulation.
1 remote session
Trial Site Locations
Total: 1 location
1
Lucile Packard Children's Hospital Stanford
Palo Alto, California, United States, 94304
Actively Recruiting
Research Team
A
Asheen Rama, MD
T
Thomas Caruso, MD, PhD
How is the study designed?
Study Type
INTERVENTIONAL
Masking
NONE
Allocation
NA
Model
SINGLE_GROUP
Primary Purpose
SUPPORTIVE_CARE
Number of Arms
1
Similar Trials
Frequently Asked Questions
Have more questions? Get in touch with our team for quick support
Not the Right Trial for You?
Explore thousands of other clinical trials that might be a better match.
Sign up to get personalized trial recommendations delivered to your inbox.
Already have an account? Log in here