Trial Outcomes & Findings for PracticeGround: Transforming Training and Delivery of Mental Health EBPs (NCT NCT02314624)

NCT ID: NCT02314624

Last Updated: 2024-08-30

Results Overview

Higher scores on subscales from this 23-item measure reflected higher depression, anxiety, stress, and suicidality. Other researchers added two suicidality items to the original 21-item measure with permission from the original authors. Each subscale score is computed by summing the subscale items, then multiplying by 2. Total possible scores for the depression, anxiety, and stress subscales range from 0-42. We categorized DASS depression, anxiety, and stress scores into severity levels coded as 0, 1, and 2: Normal (0 through 9), Mild/moderate (10 through 20), and Severe/extremely severe (21 through 42) (Psychology Foundation of Australia, 2018). The DASS suicide subscale ranged from 0-12 and not recategorized.

Recruitment status

COMPLETED

Study phase

NA

Target enrollment

142 participants

Primary outcome timeframe

baseline, 4 weeks, 8 weeks, 12 weeks

Results posted on

2024-08-30

Participant Flow

We recruited providers and their patients from 17 behavioral health clinics, outpatient clinics, and private practices. After consent, providers were randomized to WILLOW or TAU condition. Providers referred their existing new patients to the study; those deemed eligible and who consented were assigned to the same study condition as their provider.

98 providers completed eligibility screening; 91 were eligible and 76 consented to participate. 29 participating providers enrolled 1+ patients. Providers referred 119 patients to the study; 100 completed screening, 73 met eligibility criteria, 66 provided consent, and 56 attended 4+ therapy sessions and completed all data collection points.

Participant milestones

Participant milestones
Measure
WILLOW
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Overall Study
STARTED
80
62
Overall Study
COMPLETED
49
36
Overall Study
NOT COMPLETED
31
26

Reasons for withdrawal

Reasons for withdrawal
Measure
WILLOW
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Overall Study
No participating patient
16
13
Overall Study
Participant withdrew
7
2
Overall Study
Lost to Follow-up
2
5
Overall Study
Dropped/Excluded by PI
6
6

Baseline Characteristics

PracticeGround: Transforming Training and Delivery of Mental Health EBPs

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure
WILLOW
n=49 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality: Evidence-based interventions for treating depression and concurrent problems
Treatment-as-Usual
n=36 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Total
n=85 Participants
Total of all reporting groups
Age, Categorical
<=18 years
0 Participants
n=99 Participants
0 Participants
n=107 Participants
0 Participants
n=206 Participants
Age, Categorical
Between 18 and 65 years
48 Participants
n=99 Participants
35 Participants
n=107 Participants
83 Participants
n=206 Participants
Age, Categorical
>=65 years
1 Participants
n=99 Participants
1 Participants
n=107 Participants
2 Participants
n=206 Participants
Age, Continuous
43.4 years
n=99 Participants
41.2 years
n=107 Participants
42.5 years
n=206 Participants
Sex: Female, Male
Female
24 Participants
n=99 Participants
20 Participants
n=107 Participants
44 Participants
n=206 Participants
Sex: Female, Male
Male
25 Participants
n=99 Participants
16 Participants
n=107 Participants
41 Participants
n=206 Participants
Race (NIH/OMB)
American Indian or Alaska Native
1 Participants
n=99 Participants
0 Participants
n=107 Participants
1 Participants
n=206 Participants
Race (NIH/OMB)
Asian
2 Participants
n=99 Participants
2 Participants
n=107 Participants
4 Participants
n=206 Participants
Race (NIH/OMB)
Native Hawaiian or Other Pacific Islander
0 Participants
n=99 Participants
0 Participants
n=107 Participants
0 Participants
n=206 Participants
Race (NIH/OMB)
Black or African American
5 Participants
n=99 Participants
4 Participants
n=107 Participants
9 Participants
n=206 Participants
Race (NIH/OMB)
White
38 Participants
n=99 Participants
28 Participants
n=107 Participants
66 Participants
n=206 Participants
Race (NIH/OMB)
More than one race
2 Participants
n=99 Participants
1 Participants
n=107 Participants
3 Participants
n=206 Participants
Race (NIH/OMB)
Unknown or Not Reported
1 Participants
n=99 Participants
1 Participants
n=107 Participants
2 Participants
n=206 Participants
Region of Enrollment
United States
49 participants
n=99 Participants
36 participants
n=107 Participants
85 participants
n=206 Participants

PRIMARY outcome

Timeframe: baseline, 4 weeks, 8 weeks, 12 weeks

Population: Patient participants

Higher scores on subscales from this 23-item measure reflected higher depression, anxiety, stress, and suicidality. Other researchers added two suicidality items to the original 21-item measure with permission from the original authors. Each subscale score is computed by summing the subscale items, then multiplying by 2. Total possible scores for the depression, anxiety, and stress subscales range from 0-42. We categorized DASS depression, anxiety, and stress scores into severity levels coded as 0, 1, and 2: Normal (0 through 9), Mild/moderate (10 through 20), and Severe/extremely severe (21 through 42) (Psychology Foundation of Australia, 2018). The DASS suicide subscale ranged from 0-12 and not recategorized.

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Depression, Anxiety, and Stress Scale (DASS)
Baseline (depression subscale)
1.55 score on a scale
Standard Deviation .68
1.68 score on a scale
Standard Deviation .56
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (depression subscale)
1.32 score on a scale
Standard Deviation .79
1.4 score on a scale
Standard Deviation .65
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (depression subscale)
1.1 score on a scale
Standard Deviation .75
1.08 score on a scale
Standard Deviation .76
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (depression subscale)
.94 score on a scale
Standard Deviation .94
1.08 score on a scale
Standard Deviation .76
Depression, Anxiety, and Stress Scale (DASS)
Baseline (anxiety subscale)
.97 score on a scale
Standard Deviation .8
.84 score on a scale
Standard Deviation .75
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (anxiety subscale)
.81 score on a scale
Standard Deviation .75
.76 score on a scale
Standard Deviation .78
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (anxiety subscale)
.74 score on a scale
Standard Deviation .77
.76 score on a scale
Standard Deviation .83
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (anxiety subscale)
.58 score on a scale
Standard Deviation .81
.72 score on a scale
Standard Deviation .74
Depression, Anxiety, and Stress Scale (DASS)
Baseline (stress subscale)
1.55 score on a scale
Standard Deviation .68
1.60 score on a scale
Standard Deviation .58
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (stress subscale)
1.32 score on a scale
Standard Deviation .70
1.16 score on a scale
Standard Deviation .69
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (stress subscale)
1.29 score on a scale
Standard Deviation .64
1.24 score on a scale
Standard Deviation .72
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (stress subscale)
1.10 score on a scale
Standard Deviation .75
1.00 score on a scale
Standard Deviation .76
Depression, Anxiety, and Stress Scale (DASS)
Baseline (suicide subscale)
3.42 score on a scale
Standard Deviation 3.43
1.92 score on a scale
Standard Deviation 2.68
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (suicide subscale)
2.32 score on a scale
Standard Deviation 3.31
1.28 score on a scale
Standard Deviation 1.99
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (suicide subscale)
1.68 score on a scale
Standard Deviation 2.32
1.04 score on a scale
Standard Deviation 1.84
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (suicide subscale)
1.74 score on a scale
Standard Deviation 3.26
1.52 score on a scale
Standard Deviation 3.18

PRIMARY outcome

Timeframe: baseline, 4 weeks, 8 weeks, 12 weeks

Population: Patient participants

Higher scores on this 21-item reflect greater depressive symptoms in the past two weeks. All items are summed to a total score (possible range 0-63). We categorized BDI scores into severity levels coded as 0, 1, and 2: Minimal (raw scores 0 through 13), Mild/moderate (14 through 28), and Severe (29 through 63).

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Beck Depression Inventory (BDI-II)
Baseline
1.25 score on a scale
Standard Deviation .63
1.52 score on a scale
Standard Deviation .65
Beck Depression Inventory (BDI-II)
Week 4
1.16 score on a scale
Standard Deviation .82
1.12 score on a scale
Standard Deviation .78
Beck Depression Inventory (BDI-II)
Week 8
1.00 score on a scale
Standard Deviation .78
1.08 score on a scale
Standard Deviation .76
Beck Depression Inventory (BDI-II)
Week 12
.71 score on a scale
Standard Deviation .86
1.04 score on a scale
Standard Deviation .74

PRIMARY outcome

Timeframe: baseline, 4 weeks, 8 weeks, 12 weeks

Population: Patient participants

Higher scores on this ten-item measure reflects more severe depression. The total score (possible range 0-27) is created by summing the first nine items. We categorized PHQ severity levels coded as 0, 1, and 2 based on authors' research as minimal (0 through 4), mild/moderate (5 through 14), and moderately severe/severe (15 through 27). The recategorized scores are reported here.

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Patient Health Questionnaire-9 (PHQ-9)
Baseline
1.48 score on a scale
Standard Deviation .57
1.44 score on a scale
Standard Deviation .58
Patient Health Questionnaire-9 (PHQ-9)
Week 4
1.23 score on a scale
Standard Deviation .62
1.24 score on a scale
Standard Deviation .60
Patient Health Questionnaire-9 (PHQ-9)
Week 8
1.24 score on a scale
Standard Deviation .64
1.28 score on a scale
Standard Deviation .61
Patient Health Questionnaire-9 (PHQ-9)
Week 12
.97 score on a scale
Standard Deviation .71
1.08 score on a scale
Standard Deviation .76

PRIMARY outcome

Timeframe: baseline, 4 weeks, 8 weeks, 12 weeks

Population: Patient Participants

The Behavioral Activation for depression Scale Short Form has 9 questions each having a scale from 0 (Not at All) to 6 (Completely) with a total range of 0-54. Higher scores on this nine-item scale reflect lower engagement in avoidance and higher engagement in activation behaviors over the course of BA for depression.

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Baseline
18.8 score on a scale
Standard Deviation 7.37
17.3 score on a scale
Standard Deviation 6.47
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Week 4
23.4 score on a scale
Standard Deviation 9.42
20.4 score on a scale
Standard Deviation 6.68
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Week 8
24.6 score on a scale
Standard Deviation 9.05
21.3 score on a scale
Standard Deviation 7.52
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Week 12
27.7 score on a scale
Standard Deviation 8.42
23.6 score on a scale
Standard Deviation 7.88

PRIMARY outcome

Timeframe: After first study therapy session, 4 weeks, 8 weeks, 12 weeks

Population: Patient participants

We created a ten-item measure in which higher scores reflected greater satisfaction with services they received. The measure had 10 questions each having a scale of 1(Strongly Disagree) to 5(Strongly Agree) with a total range of 10-50. Higher scores indicated a better outcome.

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Mental Health Services Satisfaction Survey (MHSSS)
Baseline
37.6 score on a scale
Standard Deviation 4.91
38.8 score on a scale
Standard Deviation 7.24
Mental Health Services Satisfaction Survey (MHSSS)
Week 4
37.6 score on a scale
Standard Deviation 6.77
37.8 score on a scale
Standard Deviation 7.14
Mental Health Services Satisfaction Survey (MHSSS)
Week 8
39.2 score on a scale
Standard Deviation 4.85
37.5 score on a scale
Standard Deviation 9.00
Mental Health Services Satisfaction Survey (MHSSS)
Week 12
38.9 score on a scale
Standard Deviation 7.14
38.3 score on a scale
Standard Deviation 7.65

PRIMARY outcome

Timeframe: 4 weeks, 8 weeks, 12 weeks

Population: Patient participants

We modified this measure to include items from the BHS from Group Health. The resulting 12-item scale measures the therapeutic relationship with higher scores indicating stronger alliance. With 12 questions and each having a scale of 1(Never) to 7(Always) the total range was 12-84.

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Working Alliance Inventory (WAI)
Week 4
71.7 score on a scale
Standard Deviation 10.44
71.9 score on a scale
Standard Deviation 11.54
Working Alliance Inventory (WAI)
Week 8
73.7 score on a scale
Standard Deviation 9.13
70.5 score on a scale
Standard Deviation 11.23
Working Alliance Inventory (WAI)
Week 12
73.6 score on a scale
Standard Deviation 10.46
72.7 score on a scale
Standard Deviation 10.85

PRIMARY outcome

Timeframe: 4 weeks, 8 weeks, 12 weeks

Population: Patient participants

We developed the TTC. The Therapy Task Checklist-Patient Version with 25 questions and each having a scale of 0 (Never/Very Rarely) to 7 (All of the Time) has a total range of 0-100. Higher scores reflected more frequent use of evidence-based therapy tasks, positive outcomes.

Outcome measures

Outcome measures
Measure
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Therapy Task Checklist (TTC) - Patient Version
Week 4
45.5 score on a scale
Standard Deviation 18.76
37.9 score on a scale
Standard Deviation 18.84
Therapy Task Checklist (TTC) - Patient Version
Week 8
46.6 score on a scale
Standard Deviation 16.95
42.3 score on a scale
Standard Deviation 19.48
Therapy Task Checklist (TTC) - Patient Version
Week 12
49.6 score on a scale
Standard Deviation 19.70
39.0 score on a scale
Standard Deviation 19.69

PRIMARY outcome

Timeframe: Baseline, 12 weeks

Population: Provider participants

The Modified Practice Attitudes Scale with eight questions, each having a scale of 0 (Not at all) to 4(To a very great extent), has a total range of 0-32. Higher scores on this eight-item scale reflect more positive attitudes towards evidence-based practices.

Outcome measures

Outcome measures
Measure
WILLOW
n=25 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=23 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Modified Practice Attitudes Scale (MPAS)
Baseline
24.8 score on a scale
Standard Deviation 3.06
24.9 score on a scale
Standard Deviation 4.84
Modified Practice Attitudes Scale (MPAS)
Week 12
24.6 score on a scale
Standard Deviation 3.93
23.6 score on a scale
Standard Deviation 5.77

PRIMARY outcome

Timeframe: Baseline, 12 weeks

Population: Provider participants

The Perceptions of Computer-Assisted Therapy Questionnaire has 34 questions each having a scale of 1(Strongly Disagree) to 7 Strongly Agree). Thus, the total range was 34-238. Higher scores on this 34-item scale indicate stronger agreement with the benefits of computer-assisted therapy, or a better outcome.

Outcome measures

Outcome measures
Measure
WILLOW
n=25 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=23 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Perceptions of Computer-Assisted Therapy Questionnaire (PCAT)
Baseline
160.1 score on a scale
Standard Deviation 19.39
157.4 score on a scale
Standard Deviation 18.70
Perceptions of Computer-Assisted Therapy Questionnaire (PCAT)
Week 12
170.4 score on a scale
Standard Deviation 24.60
146.4 score on a scale
Standard Deviation 21.70

PRIMARY outcome

Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeks

Population: Provider participants. Sample sizes are smaller because this measure was e not used in the pilot study.

The ASA-Monitoring and Feedback Version (ASA-MF) measure has 18 questions each having a scale of 1(Strongly Disagree) to 5(Strongly Agree) with a total range of 18-90. Higher scores on this 18-item scale reflect positive attitudes about standardized and routine progress monitoring, or positive outcomes.

Outcome measures

Outcome measures
Measure
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
ASA-Monitoring and Feedback Version (ASA-MF)
Baseline
68.0 score on a scale
Standard Deviation 6.24
64.8 score on a scale
Standard Deviation 6.83
ASA-Monitoring and Feedback Version (ASA-MF)
Week 4
72.1 score on a scale
Standard Deviation 7.95
64.8 score on a scale
Standard Deviation 6.47
ASA-Monitoring and Feedback Version (ASA-MF)
Week 8
72.2 score on a scale
Standard Deviation 7.56
68.3 score on a scale
Standard Deviation 5.88
ASA-Monitoring and Feedback Version (ASA-MF)
Week 12
71.1 score on a scale
Standard Deviation 7.60
66.9 score on a scale
Standard Deviation 3.90

PRIMARY outcome

Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeks

Population: Provider participants. Sample sizes are smaller because the measure was not used in the pilot study.

The Monitoring and Feedback Attitudes Scale has 14 questions and each has a scale of 1(Strongly Disagree) to 5(Strongly Agree), thus the total range was 14-70. Higher scores on this 14-item measure indicate more positive attitudes about routine progress monitoring and providing feedback to patients about treatment progress, or positive outcomes.

Outcome measures

Outcome measures
Measure
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Monitoring and Feedback Attitudes Scale (MFA)
Baseline
57.9 score on a scale
Standard Deviation 4.48
55.1 score on a scale
Standard Deviation 5.68
Monitoring and Feedback Attitudes Scale (MFA)
Week 4
59.7 score on a scale
Standard Deviation 5.67
57.2 score on a scale
Standard Deviation 5.83
Monitoring and Feedback Attitudes Scale (MFA)
Week 8
58.9 score on a scale
Standard Deviation 5.29
58.0 score on a scale
Standard Deviation 6.71
Monitoring and Feedback Attitudes Scale (MFA)
Week 12
60.6 score on a scale
Standard Deviation 5.88
60.1 score on a scale
Standard Deviation 5.41

PRIMARY outcome

Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeks

Population: Provider participants. Sample sizes are smaller because the measure was not used in the pilot study.

We created a three-item measure where the total score is found by summing the items. The first two items are yes(scored 1)/no(scored 0) questions. The last item is a count measure that can be any number greater than or equal to 0. Thus, the total score can have any integer value greater than or equal to 0, with higher scores reflecting greater use of routine progress monitoring.

Outcome measures

Outcome measures
Measure
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Routine Monitoring (RM)
Baseline
1.6 score on a scale
Standard Deviation 1.76
.60 score on a scale
Standard Deviation 1.06
Routine Monitoring (RM)
Week 4
4.6 score on a scale
Standard Deviation 2.70
1.8 score on a scale
Standard Deviation 1.36
Routine Monitoring (RM)
Week 8
3.6 score on a scale
Standard Deviation 2.39
1.3 score on a scale
Standard Deviation 1.16
Routine Monitoring (RM)
Week 12
3.3 score on a scale
Standard Deviation 2.25
1.9 score on a scale
Standard Deviation 1.36

PRIMARY outcome

Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeks

Population: Provider participants. Sample sizes are smaller because the measure was not used in the pilot study.

We modified the original measure into nine items. The Current Assessment Practice Evaluation-Revised has 9 questions with each having a scale of 1(None, 0%) to 5 (Nearly All, 81-100%). Thus, the total range was 9-45 and higher scores reflect greater provider use of measurement-based care or positive outcomes.

Outcome measures

Outcome measures
Measure
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Current Assessment Practice Evaluation-Revised (CAPER)
Baseline
17.6 score on a scale
Standard Deviation 8.07
12.4 score on a scale
Standard Deviation 5.04
Current Assessment Practice Evaluation-Revised (CAPER)
Week 4
21.7 score on a scale
Standard Deviation 9.66
13.2 score on a scale
Standard Deviation 5.13
Current Assessment Practice Evaluation-Revised (CAPER)
Week 8
21.9 score on a scale
Standard Deviation 9.80
13.4 score on a scale
Standard Deviation 5.66
Current Assessment Practice Evaluation-Revised (CAPER)
Week 12
22.3 score on a scale
Standard Deviation 11.26
13.4 score on a scale
Standard Deviation 5.38

PRIMARY outcome

Timeframe: 4 weeks, 8 weeks, 12 weeks

Population: Provider participants

The Therapy Task Checklist -Provider Version has 22 questions and each have a scale of 0(Never/Very Rarely) to 4 (All of the time) with a total range of 0-88. Higher scores reflected more frequent use of evidence-based therapy tasks, or positive outcomes.

Outcome measures

Outcome measures
Measure
WILLOW
n=25 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal. Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
Treatment-as-Usual
n=23 Participants
Usual care without access to WILLOW. Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
Therapy Task Checklist (TTC) - Provider Version
Week 4
48.7 score on a scale
Standard Deviation 13.19
40.7 score on a scale
Standard Deviation 12.51
Therapy Task Checklist (TTC) - Provider Version
Week 8
51.3 score on a scale
Standard Deviation 13.33
43.7 score on a scale
Standard Deviation 10.06
Therapy Task Checklist (TTC) - Provider Version
Week 12
50.8 score on a scale
Standard Deviation 13.37
42.9 score on a scale
Standard Deviation 7.91

Adverse Events

WILLOW

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Treatment-as-Usual

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Serious adverse events

Adverse event data not reported

Other adverse events

Adverse event data not reported

Additional Information

Linda Dimeff, PhD

Evidence Based Practice Institute

Phone: 206-384-7371

Results disclosure agreements

  • Principal investigator is a sponsor employee
  • Publication restrictions are in place