Effectiveness of an Artificial Intelligent Tutoring System in Simulation Training

NCT04700384 · Status: COMPLETED · Phase: NA · Type: INTERVENTIONAL · Enrollment: 70

Last updated 2021-05-24

No results posted yet for this study

Summary

Brief Summary:

Background:

Although surgical experience and technical skill are associated with better patient outcomes, quantitating surgical ability in the operating room is challenging. In surgical education, large datasets generated by high-fidelity virtual reality simulators can be employed by machine learning algorithms to objectively measure trainee performance and competence on expert benchmarks. This allows repetitive practice of surgical skills in safe and risk-free environments with immediate feedback.

Our group developed and has a patent pending for an intelligent tutoring system called the Virtual Operative Assistant (VOA). Utilizing an Artificial Intelligence (AI) support vector machine algorithm, the VOA assesses data derived from the NeuroVR (CAE Healthcare) simulator platform and provides individualized audiovisual feedback to improve learner performance during simulated brain tumor resections. The effectiveness of intelligent tutoring systems such as the VOA to the human surgical apprenticeship pedagogy remains to be elucidated.

The aim of this study is to compare the effectiveness and educational impact of personalized VOA feedback to expert instruction on medical student's technical skills learning of a virtual reality tumor resection procedure.

Specific Aims: 1) To assess if medical students receiving personalized VOA feedback statistically improve their surgical performance when compared to those having (a) no expert instructor feedback or (b) expert instructor-mediated feedback. 2) To outline if different emotions are elicited by the VOA intelligent tutoring system in medical students while performing this achievement task as compared to human instruction

Conditions

  • Surgical Education

Interventions

BEHAVIORAL

Virtual Operative Assistant Training

Individuals receive the same basic information, have the same amount of time and perform the same scenarios as the control group. In the 5-minutes between attempts, participant receive the Virtual Operative Assistant assessment of their performance and audiovisual feedback.

BEHAVIORAL

Remote-Based Expert Instructor Training

Individuals receive the same information, have the same amount of time and perform the same scenarios as the control group. Meanwhile, a trained instructor observes the participant's on-screen performance, that is live-streamed, remotely. Instructors are senior neurosurgery residents with extensive experience in performing and assessing this scenario. During the 5-minute feedback session, they chat with the student, discussing the performance and help in setting goals for the next trial.

Sponsors & Collaborators

Principal Investigators

  • Rolando Del Maestro, MD · McGill

Study Design

Allocation
RANDOMIZED
Purpose
HEALTH_SERVICES_RESEARCH
Masking
DOUBLE
Model
PARALLEL

Eligibility

Sex
ALL
Healthy Volunteers
Yes

Timeline & Regulatory

Start
2021-01-15
Primary Completion
2021-05-15
Completion
2021-05-15

Countries

  • Canada

Study Locations

More Related Trials

Entities

Read the full study record

This page highlights key information. For complete eligibility criteria, study locations, investigator contacts, and the full protocol, visit the original record on ClinicalTrials.gov.

View NCT04700384 on ClinicalTrials.gov