Trial Outcomes & Findings for Usability Study of OnTrack Tools (NCT NCT05330234)

NCT ID: NCT05330234

Last Updated: 2024-03-18

Results Overview

In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.

Recruitment status

COMPLETED

Study phase

NA

Target enrollment

10 participants

Primary outcome timeframe

Up to 60 days.

Results posted on

2024-03-18

Participant Flow

Participant milestones

Participant milestones
Measure
Therapists
Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards. OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
Overall Study
STARTED
10
Overall Study
Phase 1
10
Overall Study
Phase 2
9
Overall Study
Phase 3
6
Overall Study
COMPLETED
6
Overall Study
NOT COMPLETED
4

Reasons for withdrawal

Withdrawal data not reported

Baseline Characteristics

Race and Ethnicity were not collected from any participant.

Baseline characteristics by cohort

Baseline characteristics by cohort
Measure
Therapists
n=10 Participants
Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards. OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
Age, Categorical
<=18 years
0 Participants
n=10 Participants
Age, Categorical
Between 18 and 65 years
10 Participants
n=10 Participants
Age, Categorical
>=65 years
0 Participants
n=10 Participants
Sex: Female, Male
Female
5 Participants
n=10 Participants
Sex: Female, Male
Male
5 Participants
n=10 Participants
Region of Enrollment
United Kingdom
10 participants
n=10 Participants

PRIMARY outcome

Timeframe: Up to 60 days.

In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.

Outcome measures

Outcome measures
Measure
Therapists (Phase 1)
n=10 Participants
Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards. OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
System Usability Scale (Phase 1)
73.3 score on a scale
Interval 62.5 to 90.0

PRIMARY outcome

Timeframe: Up to 60 days

In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.

Outcome measures

Outcome measures
Measure
Therapists (Phase 1)
n=9 Participants
Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards. OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
System Usability Scale (Phase 2)
78.3 score on a scale
Interval 72.5 to 92.5

PRIMARY outcome

Timeframe: Up to 60 days.

In systems engineering, the system usability scale (SUS) is a simple, ten-item attitude Likert scale giving a global view of subjective assessments of usability. It was developed by John Brooke\[1\] at Digital Equipment Corporation in the UK in 1986 as a tool to be used in usability engineering of electronic office systems. The measure is scored on a 0-100 scale, a higher score means a better outcome.

Outcome measures

Outcome measures
Measure
Therapists (Phase 1)
n=6 Participants
Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards. OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
System Usability Scale (Phase 3)
77.1 score on a scale
Interval 72.5 to 82.5

SECONDARY outcome

Timeframe: Up to 60 days.

The PSSUQ (Post-Study System Usability Questionnaire is a 16-item standardized questionnaire. It is widely used to measure users' perceived satisfaction of a website, software, system or product at the end of a study. PSSUQ follows a 7-point Likert Scale (+ NA option). 1 is "strongly agree" and 7 is "strongly disagree" Results are calculated by averaging the scores from the 7 points of the scale. The PSSUQ has one overall score and 3 sub-scales, namely system usefulness, information quality, and interface quality scored as follows: Overall: the average scores of questions 1 to 16 System Usefulness (SYSUSE): the average scores of questions 1 to 6 Information Quality (INFOQUAL): the average scores of questions 7 to 12 Interface Quality (INTERQUAL): the average scores of questions 13 to 15 The lower the scores, the better the performance and the higher the perceived satisfaction.

Outcome measures

Outcome measures
Measure
Therapists (Phase 1)
n=6 Participants
Single arm study. Participants are members of the therapy team at Imperial College Healthcare NHS Trust's stroke wards. OnTrack Tools: The intervention is the OnTrack Tools system consisting of a graphical user interface (GUI) used to manage patients who are users of the OnTrack rehabilitation system. Participants will be asked to complete clinical and non-clinical tasks in simulation using OnTrack Tools. The themes for the scenarios of use presented in each of the three phases are summarised below: Phase 1 - Account creation, system onboarding and general system navigation. Phase 2 - Individual patient management. Phase 3 - Content and data management.
Post-Study System Usability Questionnaire (PSSUQ)
Overall
2.6 score on a scale
Interval 1.7 to 3.1
Post-Study System Usability Questionnaire (PSSUQ)
SYSUSE
2.5 score on a scale
Interval 1.3 to 3.2
Post-Study System Usability Questionnaire (PSSUQ)
INFOQUAL
2.7 score on a scale
Interval 1.5 to 3.2
Post-Study System Usability Questionnaire (PSSUQ)
INTERQUAL
2.6 score on a scale
Interval 2.0 to 4.0

Adverse Events

Therapists

Serious events: 0 serious events
Other events: 0 other events
Deaths: 0 deaths

Serious adverse events

Adverse event data not reported

Other adverse events

Adverse event data not reported

Additional Information

Mr Gianpaolo Fusari

Imperial College London

Phone: --

Results disclosure agreements

  • Principal investigator is a sponsor employee
  • Publication restrictions are in place