The Diagnostic and Triage Capacity of Laypeople-large Language Model Collaboration in China
NCT07250516 · Status: COMPLETED · Phase: NA · Type: INTERVENTIONAL · Enrollment: 6360
Last updated 2025-11-26
Summary
The goal of this randomized controlled trial is to evaluate the role of large language models in enhancing laypeople's ability to self-diagnose and triage common diseases. The main questions it aims to answer are:
* Does using an LLM help participants make more accurate self-diagnoses and care decisions for common illnesses, compared to their first guess without any help?
* How much better is it when people work together with an LLM, compared to using a regular search engine, using the LLM alone, or how doctors would decide? Researchers will compare participants who were randomly assigned to either the LLM group (using DeepSeek) or the search engine group to see if the LLM-assisted approach leads to better clinical judgments.
Participants will:
* Read one of 48 short, realistic health vignettes;
* Make an initial guess about what might be wrong by listing up to three possible causes, ranked from most to least likely, and choose a care level: seek immediate care, see a doctor within one day, see a doctor within one week, or manage at home without medical care.
* Use their assigned tool (either DeepSeek or a standard search engine) to look up information and update their guess and care decision;
* Submit their final diagnosis and care choice after using the tool. In addition, the study team evaluated the performance of four other AI models (GPT-4o, GPT-o1, DeepSeek-v3, and DeepSeek-r1) and 33 experienced general physicians on the same vignettes.
Conditions
- Vignette Based Intervention
- LLM-based AI Dialogue Bot
Interventions
- BEHAVIORAL
-
AI-assisted health information seeking
Participants in this group used a large language model (DeepSeek) to search for medical information related to a clinical vignette after providing initial diagnostic and triage decisions. They were instructed to interact freely with the model to gather insights and then update their diagnoses and triage recommendations. The intervention simulates real-world use of AI tools for personal health decision-making
- BEHAVIORAL
-
Conventional internet search for health information
Participants in this group used mainstream internet search engines (e.g., Baidu, Google, Bing) to look up information about the clinical vignette after making initial diagnostic and triage decisions. They were allowed to search freely but were not permitted to use any named AI chatbot or large language model platform. This group represents typical self-directed online health information seeking behavior.
Sponsors & Collaborators
-
Huazhong University of Science and Technology
lead OTHER
Principal Investigators
-
Chenxi Liu · Huazhong University of Science and Technology
Study Design
- Allocation
- RANDOMIZED
- Purpose
- HEALTH_SERVICES_RESEARCH
- Masking
- SINGLE
- Model
- PARALLEL
Eligibility
- Min Age
- 18 Years
- Sex
- ALL
- Healthy Volunteers
- No
Timeline & Regulatory
- Start
- 2025-04-27
- Primary Completion
- 2025-07-01
- Completion
- 2025-07-01
Countries
- China
Study Locations
More Related Trials
-
Diagnostic Reasoning With Customized GPT-4 Model
NCT06911645 ·Status: COMPLETED ·Phase: NA
-
Physician Diagnosis of Neurologic Cases With Large Language Models
NCT07344792 ·Status: COMPLETED ·Phase: NA
-
Large Language Model-Generated Messages to Improve Guideline-Directed Medical Therapy in Heart Failure
NCT07337577 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
The Application of Large Language Model in Emergency Chest Pain Triage
NCT06493175 ·Status: RECRUITING ·Phase: NA
-
ChatGPT Helping Advance Training for Medical Students: A Study on Self-Directed Learning Enhancement
NCT06276049 ·Status: COMPLETED ·Phase: NA
-
Physician Reasoning on Diagnostic Cases With Large Language Models
NCT06157944 ·Status: COMPLETED ·Phase: NA
-
AI-Assisted Pathologist Performance Improvement: A Multicenter, Prospective, Randomized Controlled Trial
NCT07291362 ·Status: ENROLLING_BY_INVITATION ·Phase: NA
-
Randomised Controlled Trial of Artificial Intelligence-assisted Health Education
NCT07305337 ·Status: RECRUITING ·Phase: NA
-
Enhancing Medical Researchers' Self-learning With an Intelligent Language Model
NCT06015178 ·Status: UNKNOWN ·Phase: NA
-
Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support
NCT07037940 ·Status: COMPLETED ·Phase: NA
-
The Impact of Large Language Models on Diagnostic Reasoning Among LLM-Trained Medical Doctors
NCT06774612 ·Status: COMPLETED ·Phase: NA
-
The Effects of a Large Language Model on Clinical Questioning Skills
NCT06229379 ·Status: COMPLETED ·Phase: NA
-
Artificial Intelligence in Mental Illness Diagnosis and Treatment
NCT04515173 ·Status: UNKNOWN ·Phase: NA
-
Evaluation of AI-Generated Clinical Advice by Physicians
NCT06980467 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Can Feedback From a Large Language Model Improve Health Care Quality?
NCT06823765 ·Status: COMPLETED ·Phase: NA
-
Physician Reasoning on Management Cases With Large Language Models
NCT06208423 ·Status: COMPLETED ·Phase: NA
-
Evaluate the Performance of Large Language Models in Ophthalmologic Patient Consultation
NCT06824389 ·Status: COMPLETED ·Phase: NA
-
Simulated Patient and AI-based Roleplay for History-taking
NCT06766383 ·Status: COMPLETED ·Phase: NA
-
AI-Assisted Medical Decision-Making
NCT06846229 ·Status: RECRUITING
-
Large Language Models To Improve the Quality of Care of Cardiology Patients
NCT06935253 ·Status: RECRUITING ·Phase: NA
-
Artificial Intelligence in Children's Clinic
NCT04186104 ·Status: COMPLETED ·Phase: NA
-
A Conversational AI System to Enhance Knowledge About Vaccines and Promote Vaccination
NCT05689073 ·Status: COMPLETED ·Phase: NA
-
Evaluation of an Artificial Intelligence-enabled Clinical Assistant to Support Thyroid Cancer Management
NCT07234539 ·Status: ENROLLING_BY_INVITATION ·Phase: NA
-
Artificial Intelligence-Based Emergency Triage Education Tool in Enhancing Clinical Critical Thinking and Triage Practice
NCT06811987 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Using Large Language Models Such As GPT-4 to Assess Guideline Adherence in Patients With Chronic Obstructive Pulmonary Disease
NCT06410547 ·Status: COMPLETED ·Phase: NA