Effect of Agent-assisted, LLM-assisted and Traditional Workflows on Physician Admission Diagnosis
NCT07760051 · Status: NOT_YET_RECRUITING · Phase: NA · Type: INTERVENTIONAL · Enrollment: 180
Last updated 2026-08-12
Summary
The goal of this clinical trial is to evaluate whether AI-assisted workflows improve physicians' admission diagnosis performance on standardized simulated inpatient cases, among practicing internal medicine and surgery physicians across all seniority levels and across three tiers of the Chinese healthcare system.
The main questions it aims to answer are:
* Does the Agent-assisted workflow yield better structured admission diagnosis scores than standalone LLM assistance?
* Does the Agent-assisted workflow outperform the traditional workflow without AI tools? Researchers will compare three parallel groups (traditional workflow group, LLM-only group, Agent group) to determine whether the Agent tool can improve diagnostic accuracy and efficiency.
Participants will:
* Be recruited from 15 hospitals in China and participate remotely under video proctoring
* Be randomly assigned to one of the three fixed workflows, with randomization stratified by hospital tier, specialty and seniority
* Complete 6 anonymized simulated HIS admission cases within one hour
* Submit structured answers for each case covering principal diagnosis, secondary diagnoses, differential diagnoses, diagnostic justification, next diagnostic or therapeutic steps, consultation and referral decisions, and diagnostic confidence
* Have their operation logs and time consumption recorded automatically by the study platform
Conditions
- Clinical Decision Support Systems
- Diagnostic Reasoning
- Artificial Intelligence (AI)
Interventions
- OTHER
-
Agent Workflow
Conventional resources (pre-admission clinical record, search engines) plus an in-system Agent entry that automatically reads the full record and report images, produces a structured summary with source-text tracing, and supports multi-turn Q\&A and one-click editable drafts.
- OTHER
-
LLM Workflow
Conventional resources plus an in-system multi-turn AI dialogue entry. The AI does not automatically read the record; participants paste text or send partial screenshots.
- OTHER
-
traditional workflow
Conventional resources only: the pre-admission clinical record, standard search engines. No AI assistance.
Sponsors & Collaborators
-
Shangrao People's Hospital
collaborator UNKNOWN -
Second Affiliated Hospital, Zhejiang University, School of Medicine
lead OTHER
Principal Investigators
-
Yuan Ding · Second Affiliated Hospital, Zhejiang University, School of Medicine
Study Design
- Allocation
- RANDOMIZED
- Purpose
- HEALTH_SERVICES_RESEARCH
- Masking
- SINGLE
- Model
- PARALLEL
Eligibility
- Min Age
- 18 Years
- Sex
- ALL
- Healthy Volunteers
- Yes
Timeline & Regulatory
- Start
- 2026-09-30
- Primary Completion
- 2026-12-31
- Completion
- 2026-12-31
Countries
- China
Study Locations
More Related Trials
-
Assessing Knowledge, Attitudes, Trust, Perceived Usefulness, and Barriers to Using Artificial Intelligence (AI) in Gastroenterology Among Clinicians and Patients
NCT07669025 ·Status: NOT_YET_RECRUITING
-
Multi-Disciplinary Treatment on the Anthropomorphism of Large Language Models
NCT06627985 ·Status: NOT_YET_RECRUITING
-
LLM-Based Intelligent Health Management Assistant in Life-Cycle Health Management of Cardiac Surgery Patients
NCT07521488 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Evaluating a Text-Prompt AI Assistant for Chest CT Scans (AI-REPORT Study)
NCT07634861 ·Status: RECRUITING ·Phase: NA
-
AI-Assisted Learning in Medicine
NCT06945159 ·Status: COMPLETED
-
AI-Agent for Automated Diagnosis and Predicting Using EHR and Multimodal Data
NCT06791499 ·Status: RECRUITING
-
Research on Construction and Verification of Multimodal Medical Imaging Large Model
NCT07445152 ·Status: NOT_YET_RECRUITING
-
AI-Assisted Non-Contrast CT for Multi-Cancer Screening
NCT06632886 ·Status: RECRUITING ·Phase: NA
-
AI-assisted Rare Disease Diagnosis
NCT07650799 ·Status: NOT_YET_RECRUITING ·Phase: NA
-
Evaluation of an Artificial Intelligence-enabled Clinical Assistant to Support Thyroid Cancer Management
NCT07234539 ·Status: ENROLLING_BY_INVITATION ·Phase: NA
-
Large Language Models Assist in Tumor MDT
NCT07504367 ·Status: RECRUITING ·Phase: NA
-
A Platform for Multidisciplinary Medical Artificial Intelligence Development
NCT04890847 ·Status: UNKNOWN
-
The Impact of Large Language Models on Diagnostic Reasoning Among LLM-Trained Medical Doctors
NCT06774612 ·Status: COMPLETED ·Phase: NA
-
Development of an AI-Agent for Urological Disease Diagnosis and Treatment
NCT07721935 ·Status: RECRUITING
-
Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support
NCT07037940 ·Status: COMPLETED ·Phase: NA
-
AI-Assisted Staging and Treatment Decision-Making for Hepatocellular Carcinoma
NCT07538882 ·Status: RECRUITING
-
AI in Respiratory Disease Prevention, Diagnosis, and Triage
NCT06931782 ·Status: ENROLLING_BY_INVITATION ·Phase: NA
-
Multi-center Validation Study of a Large Language Model-based Intelligent Agent for Blood Cell Analysis
NCT07607184 ·Status: NOT_YET_RECRUITING
-
Effectiveness of an Ai-based Endoscopic Ultrasound Navigation System in the Training of Endoscopic Ultrasonics
NCT05421520 ·Status: UNKNOWN ·Phase: NA
-
Prospective Assessment of Alignment Between Multimodal Artificial Intelligence and Multidisciplinary Team Decisions in Gastrointestinal Oncology
NCT07746830 ·Status: NOT_YET_RECRUITING
-
Prospective User Study and Multicenter Validation of Multimodal Medical Imaging Large Models
NCT07555002 ·Status: COMPLETED
-
Effects of Expert Arbitration on Clinical Outcomes When Disputes Over Diagnosis Arise Between Physicians and Their Artificial Intelligence Counterparts: a Randomized, Multicenter Trial in Pediatric Outpatients
NCT04011761 ·Status: UNKNOWN ·Phase: NA
-
Evaluation of AI Large Models for Diagnosis and Treatment in Real-World Cases: Multicenter Retrospective Study
NCT07378358 ·Status: RECRUITING
-
Real-world Effectiveness Evaluation of Clinical Decision Support System Based on Artificial Intelligence (AI-CDSS)
NCT05065931 ·Status: COMPLETED
-
Application Evaluation Research on the Artificial Intelligence-assisted Support System for the Diagnosis of Colorectal Tubular Adenoma Lesions
NCT07073430 ·Status: RECRUITING