The Influence of Explainability and Integrability of AI-CDSS on Usage Behavior Among Primary Care Physicians

Summary

The goal of this observational experimental study is to determine how system-level features of artificial intelligence clinical decision support systems (AI-CDSS)-specifically explainability and integrability-affect usage behavior among primary care physicians in China. The study focuses on licensed primary care physicians, regardless of gender, age, years of clinical experience, or prior AI exposure.

The main questions it aims to answer are:

* Do specific AI features (e.g., feature attribution, chain-of-thought explanation, seamless workflow integration, automated data input) independently influence physicians' adoption intention, diagnostic accuracy, and their perceptions of the system's usefulness and ease of use?
* Do pairwise combinations of these AI features produce significant interaction effects-either synergistic or antagonistic-on these outcomes? Researchers will compare 32 distinct AI interface configurations generated from a 2⁶-¹ fractional factorial design (Resolution VI), each representing a unique combination of six binary AI features: (A) gradient-based feature importance (0 = absent, 1 = present), (B) chain-of-thought reasoning (0/1), (C) workflow integration (0 = multiple pop-up alerts, 1 = unified sidebar display), (D) automated data extraction (0 = manual entry, 1 = auto-populated from case text), (E) recommendation scope adapted to primary care settings (0 = restricted to essential options, 1 = full range of recommendations), and (F) model confidence display (0 = absent, 1 = present). This design enables unbiased estimation of all six main effects and all 15 two-way interactions.

Participants will:

Complete three standardized clinical case scenarios involving common respiratory infections via a web-based simulation platform; First provide an initial diagnosis and treatment plan without any AI input; Then review an AI-generated recommendation embedded with a randomly assigned combination of the six AI features; Revise their final diagnosis and prescription based on the AI suggestion; Rate their adoption intention, perceived usefulness, and perceived ease of use using validated 7-point Likert-scale items after each case.

Conditions

• Respiratory Tract Infections (RTI)

Interventions

BEHAVIORAL

AI-CDSS with Stepwise Medication and Auto-extraction

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Stepwise Medication; Auto-extraction. Inactive features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Feature Importance. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Feature Importance and Auto-extraction

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Feature Importance; Auto-extraction. Inactive features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Feature Importance and Stepwise Medication

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Feature Importance; Stepwise Medication. Inactive features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Confidence Display and Auto-extraction

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Confidence Display; Auto-extraction. Inactive features: Sidebar Display; Chain-of-Thought Reasoning; Feature Importance; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Confidence Display and Stepwise Medication

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Confidence Display; Stepwise Medication. Inactive features: Sidebar Display; Chain-of-Thought Reasoning; Feature Importance; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Confidence Display and Feature Importance

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Confidence Display; Feature Importance. Inactive features: Sidebar Display; Chain-of-Thought Reasoning; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 8)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Confidence Display; Feature Importance; Stepwise Medication; Auto-extraction. Inactive features: Sidebar Display; Chain-of-Thought Reasoning. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Chain-of-Thought Reasoning and Auto-extraction

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Auto-extraction. Inactive features: Sidebar Display; Confidence Display; Feature Importance; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Chain-of-Thought Reasoning and Stepwise Medication

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Stepwise Medication. Inactive features: Sidebar Display; Confidence Display; Feature Importance; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Chain-of-Thought Reasoning and Feature Importance

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Feature Importance. Inactive features: Sidebar Display; Confidence Display; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 12)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Feature Importance; Stepwise Medication; Auto-extraction. Inactive features: Sidebar Display; Confidence Display. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Chain-of-Thought Reasoning and Confidence Display

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Confidence Display. Inactive features: Sidebar Display; Feature Importance; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 14)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Confidence Display; Stepwise Medication; Auto-extraction. Inactive features: Sidebar Display; Feature Importance. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 15)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Confidence Display; Feature Importance; Auto-extraction. Inactive features: Sidebar Display; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 16)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Chain-of-Thought Reasoning; Confidence Display; Feature Importance; Stepwise Medication. Inactive features: Sidebar Display; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Sidebar Display and Auto-extraction

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Auto-extraction. Inactive features: Chain-of-Thought Reasoning; Confidence Display; Feature Importance; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Sidebar Display and Stepwise Medication

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Stepwise Medication. Inactive features: Chain-of-Thought Reasoning; Confidence Display; Feature Importance; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Sidebar Display and Feature Importance

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Feature Importance. Inactive features: Chain-of-Thought Reasoning; Confidence Display; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 20)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Feature Importance; Stepwise Medication; Auto-extraction. Inactive features: Chain-of-Thought Reasoning; Confidence Display. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Sidebar Display and Confidence Display

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Confidence Display. Inactive features: Chain-of-Thought Reasoning; Feature Importance; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 22)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Confidence Display; Stepwise Medication; Auto-extraction. Inactive features: Chain-of-Thought Reasoning; Feature Importance. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 23)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Confidence Display; Feature Importance; Auto-extraction. Inactive features: Chain-of-Thought Reasoning; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 24)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Confidence Display; Feature Importance; Stepwise Medication. Inactive features: Chain-of-Thought Reasoning; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with Sidebar Display and Chain-of-Thought Reasoning

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning. Inactive features: Confidence Display; Feature Importance; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 26)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Stepwise Medication; Auto-extraction. Inactive features: Confidence Display; Feature Importance. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 27)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Feature Importance; Auto-extraction. Inactive features: Confidence Display; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 28)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Feature Importance; Stepwise Medication. Inactive features: Confidence Display; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 29)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Auto-extraction. Inactive features: Feature Importance; Stepwise Medication. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 30)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Stepwise Medication. Inactive features: Feature Importance; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

AI-CDSS with 4 Features (Config 31)

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Feature Importance. Inactive features: Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

BEHAVIORAL

Full-Featured AI-CDSS

An artificial intelligence-based Clinical Decision Support System for respiratory tract infections. Active features: Sidebar Display; Chain-of-Thought Reasoning; Confidence Display; Feature Importance; Stepwise Medication; Auto-extraction. The system provides diagnosis suggestions and antibiotic recommendations for primary care physicians.

Sponsors & Collaborators

• Huazhong University of Science and Technology

  lead OTHER

Study Design

Allocation

RANDOMIZED

Purpose

HEALTH_SERVICES_RESEARCH

Masking

SINGLE

Model

FACTORIAL

Eligibility

Min Age

18 Years

Max Age

65 Years

Sex

ALL

Healthy Volunteers

No

Timeline & Regulatory

Start

2026-02-05

Primary Completion

2026-03-31

Completion

2026-04-20

Countries

• China

Study Locations