Trial Outcomes & Findings for Patient Portal Reminder/Recall for Influenza Vaccination in a Health System- UCLA Portal R/R Influenza RCT 3 (NCT NCT04533685)

Last Updated: 2022-10-25

Results Overview

Receipt of the annual influenza vaccination (between 8/1/20 - 4/1/21) among index patients. Outcomes will be assessed via vaccine data extraction from the electronic health record and external claims and pharmacy data. The index patients must also be an active UCLA Health MyChart user (\>= 1 login over the last 12 months from 8/1/20, excluding activity on the user's initial profile activation date). Individuals not affiliated with any primary care practice will be excluded from the primary analysis.

Recruitment status

COMPLETED

Study phase

Target enrollment

213773 participants

Primary outcome timeframe

6 months

Results posted on

2022-10-25

Participant Flow

Participant milestones

Participant milestones
Measure	Direct Scheduling + Pre-commitment + Pre-appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling + Pre-commitment Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	Direct Scheduling + Pre-appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit	No Direct Scheduling + Pre-commitment + Pre-Appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling + Pre-commitment Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	No Direct Scheduling + Pre-appt Reminder Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling for a flu vaccine appointment Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included)	Control Arm Participants will not receive any reminder/recall messages regarding influenza vaccination via the patient portal or other intervention components
Overall Study STARTED	17848	17842	17832	17827	17821	17819	17812	17805	71167
Overall Study COMPLETED	17848	17842	17832	17827	17821	17819	17812	17805	71167
Overall Study NOT COMPLETED	0	0	0	0	0	0	0	0	0

Reasons for withdrawal

Withdrawal data not reported

Baseline Characteristics

Patient Portal Reminder/Recall for Influenza Vaccination in a Health System- UCLA Portal R/R Influenza RCT 3

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure	Direct Scheduling + Pre-commitment + Pre-appt Reminder n=17848 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling + Pre-commitment n=17842 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	Direct Scheduling + Pre-appt Reminder n=17832 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	Direct Scheduling n=17827 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal with a link enabling direct scheduling Portal Reminders for Influenza Vaccination: Direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination that include a direct scheduling link, enabling the patient to directly schedule a flu vaccination only visit	No Direct Scheduling + Pre-commitment + Pre-Appt Reminder n=17821 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling, 2) a pre-commitment prompt and 3) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling + Pre-commitment n=17819 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) a pre-commitment prompt Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Commitment Prompt: Patients receive a pre-commitment prompt asking about their intention to get an influenza vaccination	No Direct Scheduling + Pre-appt Reminder n=17812 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling and 2) pre-appointment reminders that mention asking the provider for a flu vaccine Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included) Pre-Appointment flu vaccine reminders: Patients receive modified pre-appointment reminders for upcoming scheduled appointments that include language encouraging patients to ask the provider for the flu vaccine	No Direct Scheduling n=17805 Participants Participants receive 1) reminder/recall messages regarding influenza vaccination via the patient portal without a link enabling direct scheduling for a flu vaccine appointment Portal Reminders for Influenza Vaccination: No direct scheduling link: Patients receive reminder/recall messages via the patient portal to get an influenza vaccination (no direct scheduling link included)	Control Arm n=71167 Participants Participants will not receive any reminder/recall messages regarding influenza vaccination via the patient portal or other intervention components	Total n=213773 Participants Total of all reporting groups
Age, Customized <18 years	1556 Participants n=99 Participants	1561 Participants n=107 Participants	1535 Participants n=206 Participants	1547 Participants n=7 Participants	1511 Participants n=31 Participants	1535 Participants n=30 Participants	1546 Participants n=3 Participants	1576 Participants n=6 Participants	6071 Participants n=114 Participants	18438 Participants
Age, Customized 18-64 years	13166 Participants n=99 Participants	13234 Participants n=107 Participants	13208 Participants n=206 Participants	13202 Participants n=7 Participants	13274 Participants n=31 Participants	13148 Participants n=30 Participants	13238 Participants n=3 Participants	13122 Participants n=6 Participants	52973 Participants n=114 Participants	158565 Participants
Age, Customized 65+ years	3126 Participants n=99 Participants	3047 Participants n=107 Participants	3089 Participants n=206 Participants	3078 Participants n=7 Participants	3036 Participants n=31 Participants	3136 Participants n=30 Participants	3028 Participants n=3 Participants	3107 Participants n=6 Participants	12123 Participants n=114 Participants	36770 Participants
Sex/Gender, Customized Female	10100 Participants n=99 Participants	10130 Participants n=107 Participants	10158 Participants n=206 Participants	10028 Participants n=7 Participants	10179 Participants n=31 Participants	10169 Participants n=30 Participants	10116 Participants n=3 Participants	10190 Participants n=6 Participants	40517 Participants n=114 Participants	121587 Participants
Sex/Gender, Customized Male	7748 Participants n=99 Participants	7711 Participants n=107 Participants	7674 Participants n=206 Participants	7797 Participants n=7 Participants	7642 Participants n=31 Participants	7648 Participants n=30 Participants	7696 Participants n=3 Participants	7615 Participants n=6 Participants	30646 Participants n=114 Participants	92177 Participants
Sex/Gender, Customized Other	0 Participants n=99 Participants	0 Participants n=107 Participants	0 Participants n=206 Participants	0 Participants n=7 Participants	0 Participants n=31 Participants	0 Participants n=30 Participants	0 Participants n=3 Participants	0 Participants n=6 Participants	1 Participants n=114 Participants	1 Participants
Sex/Gender, Customized Unknown	0 Participants n=99 Participants	1 Participants n=107 Participants	0 Participants n=206 Participants	2 Participants n=7 Participants	0 Participants n=31 Participants	2 Participants n=30 Participants	0 Participants n=3 Participants	0 Participants n=6 Participants	3 Participants n=114 Participants	8 Participants
Race/Ethnicity, Customized White or Caucasian	9705 Participants n=99 Participants	9501 Participants n=107 Participants	9662 Participants n=206 Participants	9676 Participants n=7 Participants	9557 Participants n=31 Participants	9648 Participants n=30 Participants	9602 Participants n=3 Participants	9628 Participants n=6 Participants	38560 Participants n=114 Participants	115539 Participants
Race/Ethnicity, Customized Asian	1638 Participants n=99 Participants	1756 Participants n=107 Participants	1713 Participants n=206 Participants	1703 Participants n=7 Participants	1713 Participants n=31 Participants	1793 Participants n=30 Participants	1677 Participants n=3 Participants	1770 Participants n=6 Participants	6750 Participants n=114 Participants	20513 Participants
Race/Ethnicity, Customized Black	826 Participants n=99 Participants	814 Participants n=107 Participants	821 Participants n=206 Participants	849 Participants n=7 Participants	837 Participants n=31 Participants	811 Participants n=30 Participants	787 Participants n=3 Participants	829 Participants n=6 Participants	3332 Participants n=114 Participants	9906 Participants
Race/Ethnicity, Customized American Indian or Alaska Native	49 Participants n=99 Participants	53 Participants n=107 Participants	43 Participants n=206 Participants	46 Participants n=7 Participants	43 Participants n=31 Participants	34 Participants n=30 Participants	41 Participants n=3 Participants	47 Participants n=6 Participants	127 Participants n=114 Participants	483 Participants
Race/Ethnicity, Customized Multiracial	526 Participants n=99 Participants	527 Participants n=107 Participants	500 Participants n=206 Participants	517 Participants n=7 Participants	522 Participants n=31 Participants	539 Participants n=30 Participants	476 Participants n=3 Participants	494 Participants n=6 Participants	2022 Participants n=114 Participants	6123 Participants
Race/Ethnicity, Customized Other	2449 Participants n=99 Participants	2491 Participants n=107 Participants	2456 Participants n=206 Participants	2472 Participants n=7 Participants	2475 Participants n=31 Participants	2439 Participants n=30 Participants	2509 Participants n=3 Participants	2465 Participants n=6 Participants	9796 Participants n=114 Participants	29552 Participants
Race/Ethnicity, Customized Unknown	2819 Participants n=99 Participants	2921 Participants n=107 Participants	2732 Participants n=206 Participants	2679 Participants n=7 Participants	2763 Participants n=31 Participants	2727 Participants n=30 Participants	2818 Participants n=3 Participants	2716 Participants n=6 Participants	11104 Participants n=114 Participants	33279 Participants
Race/Ethnicity, Customized Not Hispanic or Latino	13227 Participants n=99 Participants	13081 Participants n=107 Participants	13272 Participants n=206 Participants	13271 Participants n=7 Participants	13164 Participants n=31 Participants	13235 Participants n=30 Participants	13111 Participants n=3 Participants	13221 Participants n=6 Participants	52663 Participants n=114 Participants	158245 Participants
Race/Ethnicity, Customized Hispanic or Latino	1802 Participants n=99 Participants	1840 Participants n=107 Participants	1828 Participants n=206 Participants	1877 Participants n=7 Participants	1894 Participants n=31 Participants	1857 Participants n=30 Participants	1883 Participants n=3 Participants	1868 Participants n=6 Participants	7400 Participants n=114 Participants	22249 Participants
Primary Language English	17504 Participants n=99 Participants	17518 Participants n=107 Participants	17521 Participants n=206 Participants	17522 Participants n=7 Participants	17451 Participants n=31 Participants	17420 Participants n=30 Participants	17451 Participants n=3 Participants	17448 Participants n=6 Participants	69771 Participants n=114 Participants	209606 Participants
Primary Language Spanish	134 Participants n=99 Participants	133 Participants n=107 Participants	135 Participants n=206 Participants	122 Participants n=7 Participants	130 Participants n=31 Participants	157 Participants n=30 Participants	145 Participants n=3 Participants	155 Participants n=6 Participants	525 Participants n=114 Participants	1636 Participants
Primary Language Other	192 Participants n=99 Participants	180 Participants n=107 Participants	166 Participants n=206 Participants	171 Participants n=7 Participants	231 Participants n=31 Participants	227 Participants n=30 Participants	198 Participants n=3 Participants	188 Participants n=6 Participants	800 Participants n=114 Participants	2353 Participants
Primary Language Uknown	18 Participants n=99 Participants	11 Participants n=107 Participants	10 Participants n=206 Participants	12 Participants n=7 Participants	9 Participants n=31 Participants	15 Participants n=30 Participants	18 Participants n=3 Participants	14 Participants n=6 Participants	71 Participants n=114 Participants	178 Participants
Primary Insurance Class Commercial	12407 Participants n=99 Participants	12544 Participants n=107 Participants	12458 Participants n=206 Participants	12393 Participants n=7 Participants	12562 Participants n=31 Participants	12443 Participants n=30 Participants	12581 Participants n=3 Participants	12367 Participants n=6 Participants	49916 Participants n=114 Participants	149671 Participants
Primary Insurance Class UCLA Managed Care	2688 Participants n=99 Participants	2700 Participants n=107 Participants	2662 Participants n=206 Participants	2760 Participants n=7 Participants	2648 Participants n=31 Participants	2683 Participants n=30 Participants	2623 Participants n=3 Participants	2723 Participants n=6 Participants	10566 Participants n=114 Participants	32053 Participants
Primary Insurance Class Medicare	2055 Participants n=99 Participants	1938 Participants n=107 Participants	2040 Participants n=206 Participants	2025 Participants n=7 Participants	1950 Participants n=31 Participants	2023 Participants n=30 Participants	1967 Participants n=3 Participants	2043 Participants n=6 Participants	7949 Participants n=114 Participants	23990 Participants
Primary Insurance Class Medi-Cal	280 Participants n=99 Participants	261 Participants n=107 Participants	270 Participants n=206 Participants	260 Participants n=7 Participants	247 Participants n=31 Participants	265 Participants n=30 Participants	263 Participants n=3 Participants	242 Participants n=6 Participants	1063 Participants n=114 Participants	3151 Participants
Primary Insurance Class Other	223 Participants n=99 Participants	216 Participants n=107 Participants	217 Participants n=206 Participants	195 Participants n=7 Participants	220 Participants n=31 Participants	197 Participants n=30 Participants	190 Participants n=3 Participants	226 Participants n=6 Participants	888 Participants n=114 Participants	2572 Participants
Primary Insurance Class Tricare	108 Participants n=99 Participants	106 Participants n=107 Participants	123 Participants n=206 Participants	121 Participants n=7 Participants	125 Participants n=31 Participants	120 Participants n=30 Participants	109 Participants n=3 Participants	117 Participants n=6 Participants	475 Participants n=114 Participants	1404 Participants
Primary Insurance Class Group Health Plan	42 Participants n=99 Participants	38 Participants n=107 Participants	27 Participants n=206 Participants	37 Participants n=7 Participants	36 Participants n=31 Participants	49 Participants n=30 Participants	31 Participants n=3 Participants	42 Participants n=6 Participants	160 Participants n=114 Participants	462 Participants
Primary Insurance Class International Payor	5 Participants n=99 Participants	4 Participants n=107 Participants	3 Participants n=206 Participants	3 Participants n=7 Participants	4 Participants n=31 Participants	5 Participants n=30 Participants	6 Participants n=3 Participants	5 Participants n=6 Participants	12 Participants n=114 Participants	47 Participants
Primary Insurance Class Self-pay	3 Participants n=99 Participants	2 Participants n=107 Participants	1 Participants n=206 Participants	2 Participants n=7 Participants	1 Participants n=31 Participants	2 Participants n=30 Participants	1 Participants n=3 Participants	3 Participants n=6 Participants	5 Participants n=114 Participants	20 Participants
Primary Insurance Class Package Billing	1 Participants n=99 Participants	0 Participants n=107 Participants	1 Participants n=206 Participants	0 Participants n=7 Participants	0 Participants n=31 Participants	1 Participants n=30 Participants	1 Participants n=3 Participants	1 Participants n=6 Participants	0 Participants n=114 Participants	5 Participants
Primary Insurance Class Unknown	36 Participants n=99 Participants	33 Participants n=107 Participants	30 Participants n=206 Participants	31 Participants n=7 Participants	28 Participants n=31 Participants	31 Participants n=30 Participants	40 Participants n=3 Participants	36 Participants n=6 Participants	133 Participants n=114 Participants	398 Participants

PRIMARY outcome

Timeframe: 6 months