Trial Outcomes & Findings for PracticeGround: Transforming Training and Delivery of Mental Health EBPs (NCT NCT02314624)
NCT ID: NCT02314624
Last Updated: 2024-08-30
Results Overview
Higher scores on subscales from this 23-item measure reflected higher depression, anxiety, stress, and suicidality. Other researchers added two suicidality items to the original 21-item measure with permission from the original authors. Each subscale score is computed by summing the subscale items, then multiplying by 2. Total possible scores for the depression, anxiety, and stress subscales range from 0-42. We categorized DASS depression, anxiety, and stress scores into severity levels coded as 0, 1, and 2: Normal (0 through 9), Mild/moderate (10 through 20), and Severe/extremely severe (21 through 42) (Psychology Foundation of Australia, 2018). The DASS suicide subscale ranged from 0-12 and not recategorized.
COMPLETED
NA
142 participants
baseline, 4 weeks, 8 weeks, 12 weeks
2024-08-30
Participant Flow
We recruited providers and their patients from 17 behavioral health clinics, outpatient clinics, and private practices. After consent, providers were randomized to WILLOW or TAU condition. Providers referred their existing new patients to the study; those deemed eligible and who consented were assigned to the same study condition as their provider.
98 providers completed eligibility screening; 91 were eligible and 76 consented to participate. 29 participating providers enrolled 1+ patients. Providers referred 119 patients to the study; 100 completed screening, 73 met eligibility criteria, 66 provided consent, and 56 attended 4+ therapy sessions and completed all data collection points.
Participant milestones
| Measure |
WILLOW
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Overall Study
STARTED
|
80
|
62
|
|
Overall Study
COMPLETED
|
49
|
36
|
|
Overall Study
NOT COMPLETED
|
31
|
26
|
Reasons for withdrawal
| Measure |
WILLOW
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Overall Study
No participating patient
|
16
|
13
|
|
Overall Study
Participant withdrew
|
7
|
2
|
|
Overall Study
Lost to Follow-up
|
2
|
5
|
|
Overall Study
Dropped/Excluded by PI
|
6
|
6
|
Baseline Characteristics
PracticeGround: Transforming Training and Delivery of Mental Health EBPs
Baseline characteristics by cohort
| Measure |
WILLOW
n=49 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal
Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality: Evidence-based interventions for treating depression and concurrent problems
|
Treatment-as-Usual
n=36 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
Total
n=85 Participants
Total of all reporting groups
|
|---|---|---|---|
|
Age, Categorical
<=18 years
|
0 Participants
n=99 Participants
|
0 Participants
n=107 Participants
|
0 Participants
n=206 Participants
|
|
Age, Categorical
Between 18 and 65 years
|
48 Participants
n=99 Participants
|
35 Participants
n=107 Participants
|
83 Participants
n=206 Participants
|
|
Age, Categorical
>=65 years
|
1 Participants
n=99 Participants
|
1 Participants
n=107 Participants
|
2 Participants
n=206 Participants
|
|
Age, Continuous
|
43.4 years
n=99 Participants
|
41.2 years
n=107 Participants
|
42.5 years
n=206 Participants
|
|
Sex: Female, Male
Female
|
24 Participants
n=99 Participants
|
20 Participants
n=107 Participants
|
44 Participants
n=206 Participants
|
|
Sex: Female, Male
Male
|
25 Participants
n=99 Participants
|
16 Participants
n=107 Participants
|
41 Participants
n=206 Participants
|
|
Race (NIH/OMB)
American Indian or Alaska Native
|
1 Participants
n=99 Participants
|
0 Participants
n=107 Participants
|
1 Participants
n=206 Participants
|
|
Race (NIH/OMB)
Asian
|
2 Participants
n=99 Participants
|
2 Participants
n=107 Participants
|
4 Participants
n=206 Participants
|
|
Race (NIH/OMB)
Native Hawaiian or Other Pacific Islander
|
0 Participants
n=99 Participants
|
0 Participants
n=107 Participants
|
0 Participants
n=206 Participants
|
|
Race (NIH/OMB)
Black or African American
|
5 Participants
n=99 Participants
|
4 Participants
n=107 Participants
|
9 Participants
n=206 Participants
|
|
Race (NIH/OMB)
White
|
38 Participants
n=99 Participants
|
28 Participants
n=107 Participants
|
66 Participants
n=206 Participants
|
|
Race (NIH/OMB)
More than one race
|
2 Participants
n=99 Participants
|
1 Participants
n=107 Participants
|
3 Participants
n=206 Participants
|
|
Race (NIH/OMB)
Unknown or Not Reported
|
1 Participants
n=99 Participants
|
1 Participants
n=107 Participants
|
2 Participants
n=206 Participants
|
|
Region of Enrollment
United States
|
49 participants
n=99 Participants
|
36 participants
n=107 Participants
|
85 participants
n=206 Participants
|
PRIMARY outcome
Timeframe: baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Patient participants
Higher scores on subscales from this 23-item measure reflected higher depression, anxiety, stress, and suicidality. Other researchers added two suicidality items to the original 21-item measure with permission from the original authors. Each subscale score is computed by summing the subscale items, then multiplying by 2. Total possible scores for the depression, anxiety, and stress subscales range from 0-42. We categorized DASS depression, anxiety, and stress scores into severity levels coded as 0, 1, and 2: Normal (0 through 9), Mild/moderate (10 through 20), and Severe/extremely severe (21 through 42) (Psychology Foundation of Australia, 2018). The DASS suicide subscale ranged from 0-12 and not recategorized.
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Depression, Anxiety, and Stress Scale (DASS)
Baseline (depression subscale)
|
1.55 score on a scale
Standard Deviation .68
|
1.68 score on a scale
Standard Deviation .56
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (depression subscale)
|
1.32 score on a scale
Standard Deviation .79
|
1.4 score on a scale
Standard Deviation .65
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (depression subscale)
|
1.1 score on a scale
Standard Deviation .75
|
1.08 score on a scale
Standard Deviation .76
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (depression subscale)
|
.94 score on a scale
Standard Deviation .94
|
1.08 score on a scale
Standard Deviation .76
|
|
Depression, Anxiety, and Stress Scale (DASS)
Baseline (anxiety subscale)
|
.97 score on a scale
Standard Deviation .8
|
.84 score on a scale
Standard Deviation .75
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (anxiety subscale)
|
.81 score on a scale
Standard Deviation .75
|
.76 score on a scale
Standard Deviation .78
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (anxiety subscale)
|
.74 score on a scale
Standard Deviation .77
|
.76 score on a scale
Standard Deviation .83
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (anxiety subscale)
|
.58 score on a scale
Standard Deviation .81
|
.72 score on a scale
Standard Deviation .74
|
|
Depression, Anxiety, and Stress Scale (DASS)
Baseline (stress subscale)
|
1.55 score on a scale
Standard Deviation .68
|
1.60 score on a scale
Standard Deviation .58
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (stress subscale)
|
1.32 score on a scale
Standard Deviation .70
|
1.16 score on a scale
Standard Deviation .69
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (stress subscale)
|
1.29 score on a scale
Standard Deviation .64
|
1.24 score on a scale
Standard Deviation .72
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (stress subscale)
|
1.10 score on a scale
Standard Deviation .75
|
1.00 score on a scale
Standard Deviation .76
|
|
Depression, Anxiety, and Stress Scale (DASS)
Baseline (suicide subscale)
|
3.42 score on a scale
Standard Deviation 3.43
|
1.92 score on a scale
Standard Deviation 2.68
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 4 (suicide subscale)
|
2.32 score on a scale
Standard Deviation 3.31
|
1.28 score on a scale
Standard Deviation 1.99
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 8 (suicide subscale)
|
1.68 score on a scale
Standard Deviation 2.32
|
1.04 score on a scale
Standard Deviation 1.84
|
|
Depression, Anxiety, and Stress Scale (DASS)
Week 12 (suicide subscale)
|
1.74 score on a scale
Standard Deviation 3.26
|
1.52 score on a scale
Standard Deviation 3.18
|
PRIMARY outcome
Timeframe: baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Patient participants
Higher scores on this 21-item reflect greater depressive symptoms in the past two weeks. All items are summed to a total score (possible range 0-63). We categorized BDI scores into severity levels coded as 0, 1, and 2: Minimal (raw scores 0 through 13), Mild/moderate (14 through 28), and Severe (29 through 63).
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Beck Depression Inventory (BDI-II)
Baseline
|
1.25 score on a scale
Standard Deviation .63
|
1.52 score on a scale
Standard Deviation .65
|
|
Beck Depression Inventory (BDI-II)
Week 4
|
1.16 score on a scale
Standard Deviation .82
|
1.12 score on a scale
Standard Deviation .78
|
|
Beck Depression Inventory (BDI-II)
Week 8
|
1.00 score on a scale
Standard Deviation .78
|
1.08 score on a scale
Standard Deviation .76
|
|
Beck Depression Inventory (BDI-II)
Week 12
|
.71 score on a scale
Standard Deviation .86
|
1.04 score on a scale
Standard Deviation .74
|
PRIMARY outcome
Timeframe: baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Patient participants
Higher scores on this ten-item measure reflects more severe depression. The total score (possible range 0-27) is created by summing the first nine items. We categorized PHQ severity levels coded as 0, 1, and 2 based on authors' research as minimal (0 through 4), mild/moderate (5 through 14), and moderately severe/severe (15 through 27). The recategorized scores are reported here.
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Patient Health Questionnaire-9 (PHQ-9)
Baseline
|
1.48 score on a scale
Standard Deviation .57
|
1.44 score on a scale
Standard Deviation .58
|
|
Patient Health Questionnaire-9 (PHQ-9)
Week 4
|
1.23 score on a scale
Standard Deviation .62
|
1.24 score on a scale
Standard Deviation .60
|
|
Patient Health Questionnaire-9 (PHQ-9)
Week 8
|
1.24 score on a scale
Standard Deviation .64
|
1.28 score on a scale
Standard Deviation .61
|
|
Patient Health Questionnaire-9 (PHQ-9)
Week 12
|
.97 score on a scale
Standard Deviation .71
|
1.08 score on a scale
Standard Deviation .76
|
PRIMARY outcome
Timeframe: baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Patient Participants
The Behavioral Activation for depression Scale Short Form has 9 questions each having a scale from 0 (Not at All) to 6 (Completely) with a total range of 0-54. Higher scores on this nine-item scale reflect lower engagement in avoidance and higher engagement in activation behaviors over the course of BA for depression.
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Baseline
|
18.8 score on a scale
Standard Deviation 7.37
|
17.3 score on a scale
Standard Deviation 6.47
|
|
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Week 4
|
23.4 score on a scale
Standard Deviation 9.42
|
20.4 score on a scale
Standard Deviation 6.68
|
|
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Week 8
|
24.6 score on a scale
Standard Deviation 9.05
|
21.3 score on a scale
Standard Deviation 7.52
|
|
Behavioral Activation for Depression Scale Short Form (BADS-SF)
Week 12
|
27.7 score on a scale
Standard Deviation 8.42
|
23.6 score on a scale
Standard Deviation 7.88
|
PRIMARY outcome
Timeframe: After first study therapy session, 4 weeks, 8 weeks, 12 weeksPopulation: Patient participants
We created a ten-item measure in which higher scores reflected greater satisfaction with services they received. The measure had 10 questions each having a scale of 1(Strongly Disagree) to 5(Strongly Agree) with a total range of 10-50. Higher scores indicated a better outcome.
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Mental Health Services Satisfaction Survey (MHSSS)
Baseline
|
37.6 score on a scale
Standard Deviation 4.91
|
38.8 score on a scale
Standard Deviation 7.24
|
|
Mental Health Services Satisfaction Survey (MHSSS)
Week 4
|
37.6 score on a scale
Standard Deviation 6.77
|
37.8 score on a scale
Standard Deviation 7.14
|
|
Mental Health Services Satisfaction Survey (MHSSS)
Week 8
|
39.2 score on a scale
Standard Deviation 4.85
|
37.5 score on a scale
Standard Deviation 9.00
|
|
Mental Health Services Satisfaction Survey (MHSSS)
Week 12
|
38.9 score on a scale
Standard Deviation 7.14
|
38.3 score on a scale
Standard Deviation 7.65
|
PRIMARY outcome
Timeframe: 4 weeks, 8 weeks, 12 weeksPopulation: Patient participants
We modified this measure to include items from the BHS from Group Health. The resulting 12-item scale measures the therapeutic relationship with higher scores indicating stronger alliance. With 12 questions and each having a scale of 1(Never) to 7(Always) the total range was 12-84.
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Working Alliance Inventory (WAI)
Week 4
|
71.7 score on a scale
Standard Deviation 10.44
|
71.9 score on a scale
Standard Deviation 11.54
|
|
Working Alliance Inventory (WAI)
Week 8
|
73.7 score on a scale
Standard Deviation 9.13
|
70.5 score on a scale
Standard Deviation 11.23
|
|
Working Alliance Inventory (WAI)
Week 12
|
73.6 score on a scale
Standard Deviation 10.46
|
72.7 score on a scale
Standard Deviation 10.85
|
PRIMARY outcome
Timeframe: 4 weeks, 8 weeks, 12 weeksPopulation: Patient participants
We developed the TTC. The Therapy Task Checklist-Patient Version with 25 questions and each having a scale of 0 (Never/Very Rarely) to 7 (All of the Time) has a total range of 0-100. Higher scores reflected more frequent use of evidence-based therapy tasks, positive outcomes.
Outcome measures
| Measure |
WILLOW
n=31 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=25 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Therapy Task Checklist (TTC) - Patient Version
Week 4
|
45.5 score on a scale
Standard Deviation 18.76
|
37.9 score on a scale
Standard Deviation 18.84
|
|
Therapy Task Checklist (TTC) - Patient Version
Week 8
|
46.6 score on a scale
Standard Deviation 16.95
|
42.3 score on a scale
Standard Deviation 19.48
|
|
Therapy Task Checklist (TTC) - Patient Version
Week 12
|
49.6 score on a scale
Standard Deviation 19.70
|
39.0 score on a scale
Standard Deviation 19.69
|
PRIMARY outcome
Timeframe: Baseline, 12 weeksPopulation: Provider participants
The Modified Practice Attitudes Scale with eight questions, each having a scale of 0 (Not at all) to 4(To a very great extent), has a total range of 0-32. Higher scores on this eight-item scale reflect more positive attitudes towards evidence-based practices.
Outcome measures
| Measure |
WILLOW
n=25 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=23 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Modified Practice Attitudes Scale (MPAS)
Baseline
|
24.8 score on a scale
Standard Deviation 3.06
|
24.9 score on a scale
Standard Deviation 4.84
|
|
Modified Practice Attitudes Scale (MPAS)
Week 12
|
24.6 score on a scale
Standard Deviation 3.93
|
23.6 score on a scale
Standard Deviation 5.77
|
PRIMARY outcome
Timeframe: Baseline, 12 weeksPopulation: Provider participants
The Perceptions of Computer-Assisted Therapy Questionnaire has 34 questions each having a scale of 1(Strongly Disagree) to 7 Strongly Agree). Thus, the total range was 34-238. Higher scores on this 34-item scale indicate stronger agreement with the benefits of computer-assisted therapy, or a better outcome.
Outcome measures
| Measure |
WILLOW
n=25 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=23 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Perceptions of Computer-Assisted Therapy Questionnaire (PCAT)
Baseline
|
160.1 score on a scale
Standard Deviation 19.39
|
157.4 score on a scale
Standard Deviation 18.70
|
|
Perceptions of Computer-Assisted Therapy Questionnaire (PCAT)
Week 12
|
170.4 score on a scale
Standard Deviation 24.60
|
146.4 score on a scale
Standard Deviation 21.70
|
PRIMARY outcome
Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Provider participants. Sample sizes are smaller because this measure was e not used in the pilot study.
The ASA-Monitoring and Feedback Version (ASA-MF) measure has 18 questions each having a scale of 1(Strongly Disagree) to 5(Strongly Agree) with a total range of 18-90. Higher scores on this 18-item scale reflect positive attitudes about standardized and routine progress monitoring, or positive outcomes.
Outcome measures
| Measure |
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
ASA-Monitoring and Feedback Version (ASA-MF)
Baseline
|
68.0 score on a scale
Standard Deviation 6.24
|
64.8 score on a scale
Standard Deviation 6.83
|
|
ASA-Monitoring and Feedback Version (ASA-MF)
Week 4
|
72.1 score on a scale
Standard Deviation 7.95
|
64.8 score on a scale
Standard Deviation 6.47
|
|
ASA-Monitoring and Feedback Version (ASA-MF)
Week 8
|
72.2 score on a scale
Standard Deviation 7.56
|
68.3 score on a scale
Standard Deviation 5.88
|
|
ASA-Monitoring and Feedback Version (ASA-MF)
Week 12
|
71.1 score on a scale
Standard Deviation 7.60
|
66.9 score on a scale
Standard Deviation 3.90
|
PRIMARY outcome
Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Provider participants. Sample sizes are smaller because the measure was not used in the pilot study.
The Monitoring and Feedback Attitudes Scale has 14 questions and each has a scale of 1(Strongly Disagree) to 5(Strongly Agree), thus the total range was 14-70. Higher scores on this 14-item measure indicate more positive attitudes about routine progress monitoring and providing feedback to patients about treatment progress, or positive outcomes.
Outcome measures
| Measure |
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Monitoring and Feedback Attitudes Scale (MFA)
Baseline
|
57.9 score on a scale
Standard Deviation 4.48
|
55.1 score on a scale
Standard Deviation 5.68
|
|
Monitoring and Feedback Attitudes Scale (MFA)
Week 4
|
59.7 score on a scale
Standard Deviation 5.67
|
57.2 score on a scale
Standard Deviation 5.83
|
|
Monitoring and Feedback Attitudes Scale (MFA)
Week 8
|
58.9 score on a scale
Standard Deviation 5.29
|
58.0 score on a scale
Standard Deviation 6.71
|
|
Monitoring and Feedback Attitudes Scale (MFA)
Week 12
|
60.6 score on a scale
Standard Deviation 5.88
|
60.1 score on a scale
Standard Deviation 5.41
|
PRIMARY outcome
Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Provider participants. Sample sizes are smaller because the measure was not used in the pilot study.
We created a three-item measure where the total score is found by summing the items. The first two items are yes(scored 1)/no(scored 0) questions. The last item is a count measure that can be any number greater than or equal to 0. Thus, the total score can have any integer value greater than or equal to 0, with higher scores reflecting greater use of routine progress monitoring.
Outcome measures
| Measure |
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Routine Monitoring (RM)
Baseline
|
1.6 score on a scale
Standard Deviation 1.76
|
.60 score on a scale
Standard Deviation 1.06
|
|
Routine Monitoring (RM)
Week 4
|
4.6 score on a scale
Standard Deviation 2.70
|
1.8 score on a scale
Standard Deviation 1.36
|
|
Routine Monitoring (RM)
Week 8
|
3.6 score on a scale
Standard Deviation 2.39
|
1.3 score on a scale
Standard Deviation 1.16
|
|
Routine Monitoring (RM)
Week 12
|
3.3 score on a scale
Standard Deviation 2.25
|
1.9 score on a scale
Standard Deviation 1.36
|
PRIMARY outcome
Timeframe: Baseline, 4 weeks, 8 weeks, 12 weeksPopulation: Provider participants. Sample sizes are smaller because the measure was not used in the pilot study.
We modified the original measure into nine items. The Current Assessment Practice Evaluation-Revised has 9 questions with each having a scale of 1(None, 0%) to 5 (Nearly All, 81-100%). Thus, the total range was 9-45 and higher scores reflect greater provider use of measurement-based care or positive outcomes.
Outcome measures
| Measure |
WILLOW
n=18 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=19 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Current Assessment Practice Evaluation-Revised (CAPER)
Baseline
|
17.6 score on a scale
Standard Deviation 8.07
|
12.4 score on a scale
Standard Deviation 5.04
|
|
Current Assessment Practice Evaluation-Revised (CAPER)
Week 4
|
21.7 score on a scale
Standard Deviation 9.66
|
13.2 score on a scale
Standard Deviation 5.13
|
|
Current Assessment Practice Evaluation-Revised (CAPER)
Week 8
|
21.9 score on a scale
Standard Deviation 9.80
|
13.4 score on a scale
Standard Deviation 5.66
|
|
Current Assessment Practice Evaluation-Revised (CAPER)
Week 12
|
22.3 score on a scale
Standard Deviation 11.26
|
13.4 score on a scale
Standard Deviation 5.38
|
PRIMARY outcome
Timeframe: 4 weeks, 8 weeks, 12 weeksPopulation: Provider participants
The Therapy Task Checklist -Provider Version has 22 questions and each have a scale of 0(Never/Very Rarely) to 4 (All of the time) with a total range of 0-88. Higher scores reflected more frequent use of evidence-based therapy tasks, or positive outcomes.
Outcome measures
| Measure |
WILLOW
n=25 Participants
Clinicians have access to WILLOW's dynamic progress monitoring, clinical decision support, rich visual displays of client outcomes, online training modules in ESTs, just-in-time training for guided real-time assistance in delivering ESTs, educational videos, and a client portal.
Evidence-based interventions for treating depression and concurrent problems in WILLOW included: Behavioral Activation for Depression, Cognitive Behavior Therapy for Insomnia, Collaborative Assessment and Management of Suicidality.
|
Treatment-as-Usual
n=23 Participants
Usual care without access to WILLOW.
Care-as-Usual Psychotherapy: Usual care psychotherapy for depression and concurrent problems
|
|---|---|---|
|
Therapy Task Checklist (TTC) - Provider Version
Week 4
|
48.7 score on a scale
Standard Deviation 13.19
|
40.7 score on a scale
Standard Deviation 12.51
|
|
Therapy Task Checklist (TTC) - Provider Version
Week 8
|
51.3 score on a scale
Standard Deviation 13.33
|
43.7 score on a scale
Standard Deviation 10.06
|
|
Therapy Task Checklist (TTC) - Provider Version
Week 12
|
50.8 score on a scale
Standard Deviation 13.37
|
42.9 score on a scale
Standard Deviation 7.91
|
Adverse Events
WILLOW
Treatment-as-Usual
Serious adverse events
Adverse event data not reported
Other adverse events
Adverse event data not reported
Additional Information
Results disclosure agreements
- Principal investigator is a sponsor employee
- Publication restrictions are in place