cRCT of AI Agent in Clinital Resoning Training

Summary

Traditional medical education has long emphasized one-way transmission of theoretical knowledge, which presents limitations in the systematic cultivation of clinical reasoning skills among medical students. Miller's pyramid of clinical competence emphasizes the gradual transformation from theoretical knowledge to clinical practice ability. Case-based learning (CBL), as a teaching method centered on real or simulated clinical cases, is a key strategy to address the above limitations. Artificial intelligence (AI)-assisted clinical reasoning training tools can overcome time and space constraints, and offer students repeatable, adaptive, and real-time feedback case training, thereby reinforcing the sustained role of CBL in clinical reasoning development. Currently, it still lacks high-quality evidence from randomized controlled trials on the impact of AI agents on medical students' clinical reasoning skills.

This study plans to evaluate the impact of an AI clinical reasoning training agent on students' clinical reasoning training outcomes and CBL learning experience.

Primary Objective: To evaluate the impact of the AI agent on student learning outcomes (course examination scores and clinical reasoning test scores).

Secondary Objective: To investigate students' AI acceptance (perceived usefulness, perceived ease of use, satisfaction, and intention to use).

This study adopts a two-arm parallel cluster randomized controlled trial design. The trial is designed and reported in accordance with the CONSORT statement.

The study population will recruit Class of 2021 medical students (8-year program) from Peking Union Medical College and Class of 2020 medical students (8-year program) from Tsinghua University School of Medicine. Both cohorts are officially enrolled in the "Comprehensive Clinical Course" for the 2025-2026 academic year, have consistent foundational knowledge in basic medicine and diagnostics, and are in the phase of clinical medicine theory learning, not yet having entered clinical practice.

Using PASS 2025 software, the sample size per arm for the cRCT is 39, with number of clusters per arm K=N/M =13, Considering a 10% attrition or exclusion rate, the target recruitment is 88 participants.

Considering potential heterogeneity in baseline between students from the two schools, and possible contamination due to discussions among dormitory mates during the intervention, this study will adopt stratified cluster randomization, first stratifying by school, then using dormitory as the smallest randomization unit. Dormitories will be sorted by the random number, with the first half allocated to the intervention group and the second half to the control group. Participants' group assignment will be revealed via unique student ID only after baseline data collection and informed consent are completed.

This study will select five topics from the "Comprehensive Clinical Course": "Infectious Diarrhea," "Viral Hepatitis," "Bloodstream Infection," "Infective Endocarditis," and "Central Nervous System Infection". Standardized cases will be provided by the teaching faculty, with two cases per topic, totaling 10 cases. These cases will be used to train AI agent. After class, the AI agent training tasks will be sent to the intervention group, and study materials will be distributed to the control group.

Course examination scores and clinical reasoning test scores are the primary outcomes. AI technology acceptance including perceived usefulness, perceived ease of use, satisfaction, and intention to use are the secondary outcomes.

This study has been approved by the Research Ethics Committee of Peking Union Medical College Hospital (Approval No.: I-26PJ0851).

Conditions

• Medical Education
• Clinical Reasoning
• AI Agent

Interventions

OTHER

AI agent

AI agent tasks for clinical reasoning training

OTHER

Study materials

Study materials including case information, questions, and answer keys

Sponsors & Collaborators

• Peking Union Medical College Hospital

  lead OTHER

Study Design

Allocation

RANDOMIZED

Purpose

OTHER

Masking

SINGLE

Model

PARALLEL

Eligibility

Sex

ALL

Healthy Volunteers

No

Timeline & Regulatory

Start

2026-04-01

Primary Completion

2026-05-08

Completion

2026-08-31

Countries

• China

Study Locations