Trial Outcomes & Findings for The Provider Awareness and Cultural Dexterity Toolkit for Surgeons Trial (NCT NCT03576495)

NCT ID: NCT03576495

Last Updated: 2024-06-07

Results Overview

The effect of PACTS curriculum on surgical residents' questionnaire scores measuring knowledge about caring for culturally diverse patients at time Period 2 (18 months). At this time, the Early Intervention Group had already received the PACTS curriculum. The Delayed Intervention Group had not received the PACTS curriculum, serving as the control group at this time period. Resident knowledge: Percent score out of 100, with range 0-100%. Higher values represent a better outcome, with 100% as the highest score possible. This is the average score for the Early Intervention and Delayed Intervention groups at Period 2.

Recruitment status

COMPLETED

Study phase

NA

Target enrollment

2901 participants

Primary outcome timeframe

Period 2 (18 months)

Results posted on

2024-06-07

Participant Flow

Recruitment of general surgery residents and surgical patients at Johns Hopkins University, Brigham and Women's Hospital, Brown University, and Eastern Virginia Medical School, Massachusetts General Hospital, Beth Israel Deaconess Medical Center, Howard University, and Washington University in St. Louis. We randomized at the site level to two groups: Early Intervention and Delayed Intervention. We reported our aggregate results for the residents and surgical patients in each group.

Inclusion criteria (Residents): All general surgery residents at all participating sites Exclusion criteria (Residents): All non-surgical residents at all participating sites Inclusion criteria (Patients): Admitted to a surgical service under the care of a participating resident with the capacity to give informed consent Exclusion criteria (Patients): Mentally impaired, admitted to intensive care

Unit of analysis: Residency Sites

Participant milestones

Participant milestones
Measure
Early Intervention Group
Residency sites (and in turn its residents) designated to the Early Intervention group will undergo assessment to evaluate residents' knowledge, attitudes, and skills prior to and after the PACTS curriculum administration. Follow-up testing will be conducted after one year to evaluate learner retention. Patients in the Early Intervention Group are patients who are cared for by a resident physician enrolled into the early intervention group, and monitors their patient satisfaction as well as clinical outcomes before and after the PACTS curriculum. PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
Residency sites and its participating residents designated to the delayed intervention group underwent baseline testing prior to the standard residency curriculum, and then received the PACTS curriculum the following year. Both between- and within-group differences will be examined based on curriculum exposure in intervention year 1 as well as within-group differences for the Delayed Intervention Group at the end of year 2. Patients designated to the Delayed Intervention Group are cared for by a resident physician enrolled into the delayed intervention group, and monitors their patient satisfaction as well as clinical outcomes before and after the PACTS curriculum. PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Period 1 (0 Months)
STARTED
1489 4
1412 4
Period 1 (0 Months)
Residents
192 4
214 4
Period 1 (0 Months)
Patients
1297 4
1198 4
Period 1 (0 Months)
COMPLETED
1438 4
1372 4
Period 1 (0 Months)
NOT COMPLETED
51 0
40 0
Period 2 (18 Months)
STARTED
1438 4
1372 4
Period 2 (18 Months)
Residents
141 4
174 4
Period 2 (18 Months)
Patients
1297 4
1198 4
Period 2 (18 Months)
COMPLETED
1438 4
1372 4
Period 2 (18 Months)
NOT COMPLETED
0 0
0 0
Period 3 (36 Months)
STARTED
1438 4
1372 4
Period 3 (36 Months)
Residents
141 4
174 4
Period 3 (36 Months)
Patients
1297 4
1198 4
Period 3 (36 Months)
COMPLETED
1438 4
1372 4
Period 3 (36 Months)
NOT COMPLETED
0 0
0 0

Reasons for withdrawal

Reasons for withdrawal
Measure
Early Intervention Group
Residency sites (and in turn its residents) designated to the Early Intervention group will undergo assessment to evaluate residents' knowledge, attitudes, and skills prior to and after the PACTS curriculum administration. Follow-up testing will be conducted after one year to evaluate learner retention. Patients in the Early Intervention Group are patients who are cared for by a resident physician enrolled into the early intervention group, and monitors their patient satisfaction as well as clinical outcomes before and after the PACTS curriculum. PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
Residency sites and its participating residents designated to the delayed intervention group underwent baseline testing prior to the standard residency curriculum, and then received the PACTS curriculum the following year. Both between- and within-group differences will be examined based on curriculum exposure in intervention year 1 as well as within-group differences for the Delayed Intervention Group at the end of year 2. Patients designated to the Delayed Intervention Group are cared for by a resident physician enrolled into the delayed intervention group, and monitors their patient satisfaction as well as clinical outcomes before and after the PACTS curriculum. PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Period 1 (0 Months)
Lost to Follow-up
51
40

Baseline Characteristics

The number of participants analyzed differs from the number enrolled due to loss to follow up.

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure
Early Intervention Group
n=4 Residency Sites
Residency sites and its residents designated to the Early Intervention group will undergo assessment to evaluate residents' knowledge, attitudes, and skills prior to and after the PACTS curriculum administration. Follow-up testing will be conducted after one year to evaluate learner retention. Patients in the Early Intervention Group are patients who are cared for by a resident physician enrolled into the early intervention group, and monitors their patient satisfaction as well as clinical outcomes before and after the PACTS curriculum. PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=4 Residency Sites
Residency sites and its participating residents designated to the delayed intervention group underwent baseline testing prior to the standard residency curriculum, and then received the PACTS curriculum the following year. Both between- and within-group differences will be examined based on curriculum exposure in intervention year 1 as well as within-group differences for the Delayed Intervention Group at the end of year 2. Patients designated to the Delayed Intervention Group are cared for by a resident physician enrolled into the delayed intervention group, and monitors their patient satisfaction as well as clinical outcomes before and after the PACTS curriculum. PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Total
n=8 Residency Sites
Total of all reporting groups
Age, Continuous
Residents
30.1 years
STANDARD_DEVIATION 3.8 • n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
30.1 years
STANDARD_DEVIATION 3.8 • n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
30.1 years
STANDARD_DEVIATION 3.79 • n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Age, Continuous
Patients
55.24 years
STANDARD_DEVIATION 17 • n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
56.07 years
STANDARD_DEVIATION 17.3 • n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
55.64 years
STANDARD_DEVIATION 17.17 • n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Sex/Gender, Customized
Resident Sex/Gender · Male
72 Participants
n=141 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
86 Participants
n=174 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
158 Participants
n=315 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
Sex/Gender, Customized
Resident Sex/Gender · Female
69 Participants
n=141 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
66 Participants
n=174 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
135 Participants
n=315 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
Sex/Gender, Customized
Resident Sex/Gender · Non-Binary, Self-Describe, Not disclosed
0 Participants
n=141 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
22 Participants
n=174 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
22 Participants
n=315 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
Sex/Gender, Customized
Patient Sex/Gender · Male
670 Participants
n=1297 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
605 Participants
n=1198 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
1275 Participants
n=2495 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
Sex/Gender, Customized
Patient Sex/Gender · Female
601 Participants
n=1297 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
588 Participants
n=1198 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
1189 Participants
n=2495 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
Sex/Gender, Customized
Patient Sex/Gender · Non-Binary, Self-Describe, Not disclosed
26 Participants
n=1297 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
5 Participants
n=1198 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
31 Participants
n=2495 Participants • The number of participants enrolled differed from the number analyzed due to loss to follow up.
Ethnicity (NIH/OMB)
Residents · Hispanic or Latino
15 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
10 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
25 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
Ethnicity (NIH/OMB)
Residents · Not Hispanic or Latino
123 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
119 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
242 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
Ethnicity (NIH/OMB)
Residents · Unknown or Not Reported
3 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
45 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
48 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
Ethnicity (NIH/OMB)
Patients · Hispanic or Latino
146 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
53 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
199 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
Ethnicity (NIH/OMB)
Patients · Not Hispanic or Latino
944 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
1020 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
1964 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
Ethnicity (NIH/OMB)
Patients · Unknown or Not Reported
207 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
125 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
332 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up
Race/Ethnicity, Customized
Residents · White
73 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
90 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
163 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Residents · Black
23 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
11 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
34 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Residents · Asian
28 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
20 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
48 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Residents · Multiracial/other
17 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
14 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
31 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Residents · Not disclosed
0 Participants
n=141 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
39 Participants
n=174 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
39 Participants
n=315 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Patients · White
797 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
779 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
1576 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Patients · Black
269 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
320 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
589 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Patients · Asian
32 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
30 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
62 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Patients · Multiracial/other
172 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
61 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
233 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Race/Ethnicity, Customized
Patients · Not disclosed
27 Participants
n=1297 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
8 Participants
n=1198 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
35 Participants
n=2495 Participants • The number of participants analyzed differs from the number enrolled due to loss to follow up.
Education
Residents · No schooling, or completed to 1 or more years
0 Participants
n=141 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
0 Participants
n=174 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
0 Participants
n=315 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Residents · Associates & Bachelors
0 Participants
n=141 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
0 Participants
n=174 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
0 Participants
n=315 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Residents · Master, Professional, and Doctorate
141 Participants
n=141 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
174 Participants
n=174 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
315 Participants
n=315 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Residents · Not disclosed
0 Participants
n=141 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
0 Participants
n=174 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
0 Participants
n=315 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Patients · No schooling, or completed to 1 or more years
700 Participants
n=1297 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
634 Participants
n=1198 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
1334 Participants
n=2495 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Patients · Associates & Bachelors
350 Participants
n=1297 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
304 Participants
n=1198 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
654 Participants
n=2495 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Patients · Master, Professional, and Doctorate
206 Participants
n=1297 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
148 Participants
n=1198 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
354 Participants
n=2495 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
Education
Patients · Not disclosed
41 Participants
n=1297 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
112 Participants
n=1198 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.
153 Participants
n=2495 Participants • The number of analyzed differs from the number enrolled due to loss to follow up. The participants in the Early and Delayed Resident Groups are all physicians and therefore, are categorized as Master, Professional, and Doctorate degree level for education.

PRIMARY outcome

Timeframe: Period 2 (18 months)

Population: Mean resident knowledge scores (from 0-100%) for surgical residents in both the Early Intervention and Delayed Intervention groups at Period 2 (18 months). Of the residents who completed the trial (141 for Early Intervention Group; 174 for Delayed Intervention Group), only 52 residents in the Early Intervention and 55 residents in the Delayed Intervention Group participated in the resident assessment at Period 2.

The effect of PACTS curriculum on surgical residents' questionnaire scores measuring knowledge about caring for culturally diverse patients at time Period 2 (18 months). At this time, the Early Intervention Group had already received the PACTS curriculum. The Delayed Intervention Group had not received the PACTS curriculum, serving as the control group at this time period. Resident knowledge: Percent score out of 100, with range 0-100%. Higher values represent a better outcome, with 100% as the highest score possible. This is the average score for the Early Intervention and Delayed Intervention groups at Period 2.

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=52 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=55 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Change in Residents' Questionnaire Scores Measuring Knowledge From Pre- to Post-PACTS Curriculum
74.3 score on a scale
Standard Deviation 8.96
71.7 score on a scale
Standard Deviation 13.39

PRIMARY outcome

Timeframe: Period 2 (18 months)

Population: Percentage of residents who reported "somewhat prepared" and "very well prepared" for the cross cultural survey in both the Early Intervention and Delayed Intervention groups at time period 2. Of the residents who completed the trial (141 for Early Intervention Group; 174 for Delayed Intervention Group), only 52 residents in the Early Intervention and 55 residents in the Delayed Intervention Group completed the Cross Cultural Care Survey at Period 2.

The effect of PACTS curriculum on surgical residents' cross cultural care survey about caring for culturally diverse patients at time Period 2 (18 months). At this time period, the Early Intervention group received the PACTS curriculum, while the Delayed Intervention Group had not received the PACTS curriculum, serving as the control group. The cross cultural care survey was evaluated using a modified Likert type scale (with scale ranging from lowest to highest: very unprepared, somewhat unprepared, somewhat prepared, very well prepared). Resident scores were dichotomized into two groups, those reporting "very unprepared" and "somewhat unprepared", and those reporting "somewhat prepared" and "very well prepared." Here reported values are representative of the percentage of participants who reported "somewhat prepared" and "very well prepared" at time Period 2.

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=52 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=55 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Change in Residents' Cross Cultural Care Survey Scores From Pre- to Post-PACTS Curriculum
88.2 percentage of participants
88.2 percentage of participants

PRIMARY outcome

Timeframe: Period 2 (18 months)

Population: Of the residents who completed the trial (141 for Early Intervention Group; 174 for Delayed Intervention Group), only 52 residents in the Early Intervention and 55 residents in the Delayed Intervention Group participated in the questionnaire regarding self-assessed skills.

The effect of PACTS curriculum on surgical residents' self-assessed skills for caring for culturally diverse patients at time Period 2 (18 months). Self-assessed skills ranged from levels 1 to levels 4, with level 1 indicated less skilled, and level 4 indicating skillful. For purposes of comparison, resident scores were dichotomized into two groups: less skilled (referring to skill levels 1 and 2), and skillful (levels 3 and 4). Here reported values are representative of the percentage of participants who reported skill levels 3 or 4, indicating skillful. Results here demonstrate the proportion of residents in the Early Intervention (Intervention) group and Delayed Intervention (control group) who self-evaluated their skills as skillful at Period 2.

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=52 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=55 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Change in Residents' Questionnaire Scores Regarding Self-Assessed Skills From Pre- to Post-PACTS Curriculum
85.0 percentage of "skillful" participants
84.1 percentage of "skillful" participants

PRIMARY outcome

Timeframe: Period 2 (18 months)

Population: Of the residents who completed the trial (141 for Early Intervention Group; 174 for Delayed Intervention Group), only 52 residents in the Early Intervention and 55 residents in the Delayed Intervention Group completed the questionnaire on beliefs at time Period 2.

The effect of PACTS curriculum on surgical residents' beliefs regarding caring for culturally diverse patients at time Period 2 (18 months). At this time, the Early Intervention Group had already received the PACTS curriculum. The Delayed Intervention Group had not received the PACTS curriculum, serving as the control group at this time period. The questionnaire was scored using a modified Likert type scale with a range from lowest to highest: strongly disagree, moderately disagree, mildly disagree, strongly agree, moderately agree, mildly agree. Answers were dichotomized into two groups: strongly disagree, moderately disagree, and mildly disagree; and strongly agree, moderately agree, and mildly agree. Here reported values are representative of the proportion of participants who answered "strongly agree, moderately agree, and mildly agree."

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=52 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=55 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Change in Residents' Questionnaire Scores Regarding Their Beliefs From Pre- to Post-PACTS Curriculum
92.4 percentage of participants
89.9 percentage of participants

PRIMARY outcome

Timeframe: Period 2 (18 months)

Population: Of the residents who completed the trial (141 for Early Intervention Group; 174 for Delayed Intervention Group), only 59 residents in the Early Intervention and 111 residents in the Delayed Intervention Group completed the the OSCE at Period 2. Only 105 residents performed the OSCE on Limited English Proficiency in the Delayed Group

Standardized Patient observers evaluated surgical residents on multiple dimensions of cultural dexterity and communication skills using Likert-type scales. The scale range, from lowest to highest was: "Not at all; a little bit; somewhat; mostly; a great deal." Scores were put into two groups: 1) not at all, a little bit, and somewhat; 2) mostly and a great deal. The percentage of residents who received scores of "mostly" and "a great deal" in categories of trust, limited english proficiency, consent, and pain were reported.

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=59 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=111 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Objective Structured Clinical Examination Scores
Limited English Proficiency/Informed Consent Period 2
60.9 difference in the percentage
63.1 difference in the percentage
Objective Structured Clinical Examination Scores
Trust/Pain Period 2
58.6 difference in the percentage
64.8 difference in the percentage

SECONDARY outcome

Timeframe: Period 2 (18 months)

Population: Patient reported satisfaction surveys at Periods 2 (18 months). Of the 1297 patients in the Early Intervention Group, and 1198 patients in the Delayed Intervention Group, only 436 patients and 392 patients, respectively, completed the survey at Period 2.

We used an adapted version of the Hospital Consumer Assessment of Healthcare Providers and Systems (HCAHPS) to assess patients' (1) satisfaction with pain management, (2) satisfaction with communication including specific measures for limited English proficiency (LEP), (3) trust, and (4) comprehension of informed consent. Patient satisfaction was captured using a modified Likert scale from lowest to highest: strongly disagree, disagree, neither agree nor disagree, agree, and strongly agree. The values reported below are the percentage of participants who reported "agree" or "strongly agree."

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=436 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=392 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Patients' Self-reported Satisfaction Scores
Trust Period 2
72.06 percentage of participants
75.25 percentage of participants
Patients' Self-reported Satisfaction Scores
Limited English Proficiency Period 2
53.48 percentage of participants
51.56 percentage of participants
Patients' Self-reported Satisfaction Scores
Consent Period 2
77.94 percentage of participants
82.7 percentage of participants
Patients' Self-reported Satisfaction Scores
Pain Period 2
81.0 percentage of participants
81.19 percentage of participants

SECONDARY outcome

Timeframe: Period 2 (18 months)

Population: Comparison of length of stay for patients admitted to the hospital and cared for by residents in the early versus delayed intervention groups. The analysis population differs from the overall number of patients because not all patients had a recorded length of stay. Of those that we had length of stay data for, there were 255 participants in the Early Intervention group at Period 2, and 386 participants in the Delayed Intervention group at Period 2.

National Surgical Quality Improvement Program (NSQIP) metrics for each patient participant capturing hospital length of stay in days. Patients designated to Early Intervention Group were cared for by a resident enrolled in the Early Intervention group, where the PACTS curriculum was administered between period 1 (0 months) and period 2 (18 months). Patients designated to the Delayed Intervention group were cared for by a resident enrolled in the Delayed Intervention group, where the standard curriculum was administered between period 1 (0 months) and period 2 (18 months). We are comparing median length of stay at period 2.

Outcome measures

Outcome measures
Measure
Early Intervention Group
n=255 Participants
The investigators will assess the residents' knowledge after the PACTS curriculum administration at half the sites (Early Intervention Group). Post-exposure effect in the Early Intervention Group was assessed at Period 2 (18 months). PACTS curriculum: The cultural dexterity curriculum, known as PACTS (Provider Awareness Cultural Dexterity Toolkit for Surgeons) focuses on developing cognitive skills to adapt to individual patients' needs to ensure personal, patient-centered surgical care. The curriculum is comprised of four educational modules on establishing trust in the physician-patient relationship, communicating effectively with patients with limited English proficiency, discussing informed consent, and issues surrounding pain management. Each module consists of an independent learning activity, an interactive role-play, and a post-lesson assessment.
Delayed Intervention Group
n=386 Participants
At 18 months (Period 2), resident knowledge was assessed using the standard residency curriculum.
Median Hospital Length of Stay for Patient Participants
8.85 Days
Interval 5.35 to 12.35
14.16 Days
Interval 8.66 to 19.66

Adverse Events

Early Intervention / Retention Group, Residents

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Delayed Intervention Group, Residents

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Early Intervention Group, Patients

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Delayed Intervention Group, Patients

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Serious adverse events

Adverse event data not reported

Other adverse events

Adverse event data not reported

Additional Information

Dr. Douglas S. Smink

Brigham and Women's Hospital

Phone: 617-983-7260

Results disclosure agreements

  • Principal investigator is a sponsor employee
  • Publication restrictions are in place