MedTrace Logo

Evaluation of AI Large Models for Diagnosis and Treatment in Real-World Cases: Multicenter Retrospective Study

NCT07378358 · Status: RECRUITING · Type: OBSERVATIONAL · Enrollment: 800

Last updated 2026-01-30

No results posted yet for this study

Summary

This multicenter retrospective study aims to evaluate the diagnostic and therapeutic performance of three large language models-ChatGPT, Gemini and Deepseek-using 800 archived inpatient medical records from urology departments across four tertiary hospitals. The study will focus on the accuracy and applicability of these models in disease recognition, preliminary diagnosis and treatment recommendation generation, in order to explore their potential value and limitations in supporting clinical decision-making in real-world settings.

Conditions

  • Urologic Diseases

Interventions

OTHER

Large Language Model Assessment (ChatGPT, Gemini, DeepSeek)

De-identified inpatient medical records were retrospectively collected from the urology departments of four tertiary hospitals (200 cases per site, 800 in total). Each case included standardized clinical information such as demographics, chief complaint, history of present illness, past medical history, physical examination, laboratory and imaging findings, discharge diagnosis and treatment plan. To simulate the role of an AI system in a "first-visit physician" scenario, all diagnostic conclusions, differential diagnoses and treatment plans were removed before being input into the models. Three large language models (ChatGPT, Gemini and DeepSeek) were prompted with a standardized instruction: "Based on the above clinical information, provide your preliminary diagnosis, differential diagnoses and treatment recommendations." Each model generated outputs including (i) primary and secondary diagnoses, (ii) differential diagnosis lists with reasoning and (iii) preliminary treatment suggesti

Sponsors & Collaborators

  • First Affiliated Hospital of Fujian Medical University

    lead OTHER

Eligibility

Min Age
18 Years
Sex
ALL
Healthy Volunteers
No

Timeline & Regulatory

Start
2026-01-01
Primary Completion
2026-04-01
Completion
2026-06-01

Countries

  • China

Study Locations

More Related Trials

Read the full study record

This page highlights key information. For complete eligibility criteria, study locations, investigator contacts, and the full protocol, visit the original record on ClinicalTrials.gov.

View NCT07378358 on ClinicalTrials.gov