Improving AI-Assisted Medical Diagnosis and Triage by the General Public
NCT07728513 · Status: RECRUITING · Phase: NA · Type: INTERVENTIONAL · Enrollment: 220
Last updated 2026-07-27
Summary
This study is a randomized controlled trial (RCT) investigating whether access to a new LLM interface can improve medical triage and diagnostic accuracy for laypeople compared to access to a standard LLM interface. It addresses previous findings where laypeople using standard LLMs performed worse than those using conventional methods (e.g., web search) due to incomplete symptom sharing and poor interpretation of AI advice. To address this, the research tests a structured LLM system that proactively asks clinical history questions before providing a standardized, easy-to-read diagnostic output.
Conditions
- AI-Assisted Diagnosis
- Large Language Models
Interventions
- DEVICE
-
new GPT-4o Interface
Participants can access any assistance methods they would typically employ (e.g., web search or health portals) in addition to a new LLM (GPT-4o) interface to complete medical scenarios. The new LLM interface uses a fixed system prompt that (a) instructs the model to ask targeted clarifying questions before providing any diagnostic or triage suggestions, and (b) requires all final responses to follow a structured template listing: possible conditions, approximate likelihood of each, and a recommended triage with brief reasoning.
- OTHER
-
Control
Participants use any assistance methods they would typically employ at home (e.g., Google or health portals) in addition to a standard LLM (GPT-4o) to complete medical scenarios. AI-overview in web searches will be disabled via an extension. They would not be allowed to access any LLMs other than the standard LLM interface.
Sponsors & Collaborators
-
Lahore University of Management Sciences
lead OTHER
Principal Investigators
-
Ihsan Ayyub Qazi, PhD · Lahore University of Management Sciences (LUMS)
-
Ayesha Ali, PhD · Lahore University of Management Sciences (LUMS)
-
Zafar Ayyub Qazi, PhD · Lahore University of Management Sciences (LUMS)
Study Design
- Allocation
- RANDOMIZED
- Purpose
- DIAGNOSTIC
- Masking
- SINGLE
- Model
- PARALLEL
Eligibility
- Min Age
- 18 Years
- Sex
- ALL
- Healthy Volunteers
- Yes
Timeline & Regulatory
- Start
- 2026-07-25
- Primary Completion
- 2027-07-01
- Completion
- 2027-07-01
Countries
- Pakistan
Study Locations
More Related Trials
-
Improving the Accuracy of Artificial Intelligence Triage in Primary Care
NCT07237919 ·Status: RECRUITING ·Phase: NA
-
A Conversational AI System to Enhance Knowledge About Vaccines and Promote Vaccination
NCT05689073 ·Status: COMPLETED ·Phase: NA
-
Generating Fast and Slow for Entree Level Medical Knowledge
NCT06247475 ·Status: NOT_YET_RECRUITING
-
OpenEvidence Safety and Comparative Efficacy of Four LLM's in Clinical Practice
NCT07199231 ·Status: ACTIVE_NOT_RECRUITING
-
AI-generated Feedback in Social Robotic Virtual Patients
NCT07277829 ·Status: COMPLETED ·Phase: NA
-
Evaluation of the Efficacy and Usability of Artificial Intelligence (ChatGPT) for Health Sciences Students
NCT05963802 ·Status: COMPLETED ·Phase: NA
-
AI vs Human Exam Assessment and Development (AHEAD Trial)
NCT07481162 ·Status: COMPLETED ·Phase: NA
-
Attitudes and Perceptions of Corresponding Authors From Top International Medical Journals Regarding the Use of Artificial Intelligence in the Scientific Process
NCT07326501 ·Status: ENROLLING_BY_INVITATION
-
Explainable AI in Medical Education: CerViD-MultiModal Framework Trial
NCT07743658 ·Status: COMPLETED ·Phase: NA
-
Clinical Intelligent Management System Pragmatic RCT
NCT06893068 ·Status: RECRUITING ·Phase: NA
-
The Impact of Chatbot-aid on Promoting Self-management of Men's Health in the Post COVID-19 Era
NCT05765331 ·Status: UNKNOWN ·Phase: NA
-
AI-Driven Consent Simplification Study
NCT07303517 ·Status: RECRUITING
-
Artificial Intelligence in Mental Illness Diagnosis and Treatment
NCT04515173 ·Status: UNKNOWN ·Phase: NA
-
AI Chatbot for HPV Vaccine Literacy Among Caregivers in Japan
NCT06702423 ·Status: COMPLETED ·Phase: NA
-
LLM-CoManage: Large Language Model-Enabled Co-Management of Hypertension, Diabetes, and Dyslipidemia
NCT07350486 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Assessing Psoriasis Treatment Outcomes
NCT07391423 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Testing the Efficacy of an Artificial Intelligence Real-Time Coaching SystemSystemSimulatioTraining of Medical Students
NCT05168150 ·Status: COMPLETED ·Phase: NA
-
Effectiveness of an Edge AI-based Augmented Reality System for Hand Hygiene Training: a Multi-centre, Mixed-methods Cluster Randomised Controlled Trial
NCT07280026 ·Status: RECRUITING ·Phase: NA
-
Testing the Effectiveness of AI Chatbots to Improve Public Knowledge and Attitudes Towards Depression
NCT06858371 ·Status: ACTIVE_NOT_RECRUITING ·Phase: NA
-
The Influence of Explainability and Integrability of AI-CDSS on Usage Behavior Among Primary Care Physicians
NCT07401979 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Harnessing Health IT to Promote Equitable Care for Patients with Limited English Proficiency and Complex Care Needs
NCT05860777 ·Status: COMPLETED ·Phase: NA
-
AI-Powered Mental Health Screening in University Students
NCT07092085 ·Status: COMPLETED
-
The Impact of a Web-based Psychoeducation Programme with a Motivational AI Chatbot on Covid-19 Vaccine Hesitancy
NCT05531058 ·Status: COMPLETED ·Phase: NA
-
Voice Technology-Based Self-Management Intervention
NCT06982261 ·Status: RECRUITING ·Phase: NA
-
Original Medical Notes Versus AI Plain-Language Summaries
NCT07602725 ·Status: NOT_YET_RECRUITING ·Phase: NA