Improving the Reliability of LLMs as Medical Assistants for the General Public
NCT07651280 · Status: RECRUITING · Phase: NA · Type: INTERVENTIONAL · Enrollment: 525
Last updated 2026-07-07
Summary
This study will evaluate whether three-minute six-dimensions education(3M-6D education) can improve the reliability of large language models as medical assistants for the general public. Participants will be randomly assigned to receive or not receive 3M-6D education and then use ChatGPT, Gemini, or non-AI information resources. The study will assess relevant condition identification, disposition concordance, red-flag identification, and NASA-TLX score.
Conditions
- Relevant Conditions Identification
Interventions
- BEHAVIORAL
-
three minutes six dimensions education
3M-6D education is designed based on Cognitive Load Theory to reduce the cognitive burden on patients during medical interactions with AI and to improve the clarity and completeness of symptom reporting. Guided by cognitive load theory and the natural process physicians use to take medical histories, the investigators identified candidate information dimensions and developed a structured expression framework with six dimensions for public health queries through a Delphi expert consensus process. Participants were instructed to use the framework to describe their symptoms across these six dimensions; this process can typically be completed within three minutes, so the investigators call this approach three minutes six dimensions education (3M-6D education).
- OTHER
-
ChatGPT
Participants use ChatGPT to complete a standardized simulated clinical scenarios in unrestricted natural language.
- OTHER
-
Gemini
Participants use Gemini to complete a standardized simulated clinical scenarios in unrestricted natural language.
Sponsors & Collaborators
-
Xuanwu Hospital, Beijing
collaborator OTHER -
Capital Medical University
lead OTHER
Study Design
- Allocation
- RANDOMIZED
- Purpose
- HEALTH_SERVICES_RESEARCH
- Masking
- SINGLE
- Model
- PARALLEL
Eligibility
- Min Age
- 18 Years
- Sex
- ALL
- Healthy Volunteers
- Yes
Timeline & Regulatory
- Start
- 2026-07-03
- Primary Completion
- 2026-07-20
- Completion
- 2026-07-20
Countries
- China
Study Locations
More Related Trials
-
On-Demand AI Support Via LINE-Based GPT Assistant to Improve Emotional Resilience and Reduce Burnout Among Clinical Nurses
NCT07380685 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
A Conversational AI System to Enhance Knowledge About Vaccines and Promote Vaccination
NCT05689073 ·Status: COMPLETED ·Phase: NA
-
AI Chatbots for Anxiety Mental Health Literacy
NCT07316374 ·Status: ACTIVE_NOT_RECRUITING ·Phase: NA
-
Testing the Effectiveness of AI Chatbots to Improve Public Knowledge and Attitudes Towards Depression
NCT06858371 ·Status: ACTIVE_NOT_RECRUITING ·Phase: NA
-
Clinical Intelligent Management System Pragmatic RCT
NCT06893068 ·Status: RECRUITING ·Phase: NA
-
LLM-CoManage: Large Language Model-Enabled Co-Management of Hypertension, Diabetes, and Dyslipidemia
NCT07350486 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Young People Aged 18-25 With Depression or Anxiety Mood Participate in an LLM-based Digital Dialogue Intervention Study
NCT06346496 ·Status: COMPLETED ·Phase: NA
-
AI-Augmented Motivational Interviewing Training for Primary Care
NCT06597123 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Evaluation of the Efficacy and Usability of Artificial Intelligence (ChatGPT) for Health Sciences Students
NCT05963802 ·Status: COMPLETED ·Phase: NA
-
AI Chatbot for HPV Vaccine Literacy Among Caregivers in Japan
NCT06702423 ·Status: COMPLETED ·Phase: NA
-
LLM-Assisted vs Manual Writing for Clinical Documentation: Effects on Time and Quality
NCT07187050 ·Status: COMPLETED ·Phase: NA
-
Effects of Virtual Assistant Features on User Experience in Service Settings
NCT07666295 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
AI-generated Feedback in Social Robotic Virtual Patients
NCT07277829 ·Status: COMPLETED ·Phase: NA
-
Original Medical Notes Versus AI Plain-Language Summaries
NCT07602725 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Mitigating Automation Bias in Physician-LLM Diagnostic Reasoning Using Behavioral Nudges
NCT07328815 ·Status: COMPLETED ·Phase: NA
-
A Pilot Randomized Controlled Trial of Chatbot Use in Older Adults for Lifestyle Change
NCT06901037 ·Status: RECRUITING ·Phase: NA
-
Use of Artificial Intelligence by Urogynecologic Patients
NCT06481436 ·Status: ACTIVE_NOT_RECRUITING ·Phase: NA
-
Attitudes and Perceptions of Corresponding Authors From Top International Medical Journals Regarding the Use of Artificial Intelligence in the Scientific Process
NCT07326501 ·Status: ENROLLING_BY_INVITATION
-
Clinical Language Evaluation With AI for Residents
NCT07222644 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
OpenEvidence Safety and Comparative Efficacy of Four LLM's in Clinical Practice
NCT07199231 ·Status: ACTIVE_NOT_RECRUITING
-
Automation Bias in Physician-LLM Diagnostic Reasoning
NCT06963957 ·Status: COMPLETED ·Phase: NA
-
AI vs Human Exam Assessment and Development (AHEAD Trial)
NCT07481162 ·Status: COMPLETED ·Phase: NA
-
Artificial Intelligence Powered Mental Health Support Tool For Physicians In Training
NCT07087119 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Generative AI Plan for Care Lab Study
NCT07552311 ·Status: RECRUITING ·Phase: NA
-
Adaptive Real-Time Voice Virtual Patients for Clinical Communication Training
NCT07615621 ·Status: COMPLETED ·Phase: NA