MedTrace Logo

Physician Response Evaluation With Contextual Insights vs. Standard Engines - Artificial Intelligence RAG vs LLM Clinical Decision Support

NCT07037940 · Status: COMPLETED · Phase: NA · Type: INTERVENTIONAL · Enrollment: 27

Last updated 2026-04-09

No results posted yet for this study

Summary

Clinical decision support tools powered by artificial intelligence are being rapidly integrated into medical practice. Two leading systems currently available to clinicians are OpenEvidence, which uses retrieval-augmented generation to access medical literature, and GPT-4, a large language model. While both tools show promise, their relative effectiveness in supporting clinical decision-making has not been directly compared. This study aims to evaluate how these tools influence diagnostic reasoning and management decisions among internal medicine physicians.

Conditions

  • Large Language Models

Interventions

OTHER

OpenEvidence

Medical information platform which uses retrieval-augmented generation to access medical literature

OTHER

GPT-4

A chatbot application developed that uses GPT-4, a large language model, to engage in conversational interactions with users.

Sponsors & Collaborators

  • Montefiore Medical Center

    lead OTHER

Principal Investigators

  • Shitij Arora, MD · Montefiore Medical Center

Study Design

Allocation
RANDOMIZED
Purpose
OTHER
Masking
SINGLE
Model
PARALLEL

Eligibility

Min Age
25 Years
Sex
ALL
Healthy Volunteers
Yes

Timeline & Regulatory

Start
2025-07-03
Primary Completion
2025-12-30
Completion
2025-12-30

Countries

  • United States

Study Locations

More Related Trials

Read the full study record

This page highlights key information. For complete eligibility criteria, study locations, investigator contacts, and the full protocol, visit the original record on ClinicalTrials.gov.

View NCT07037940 on ClinicalTrials.gov