Feasibility and Efficacy of Assisstive Tactile and Auditory Communicating Devices

Summary

This pilot study will integrate multi-sensor fusion techniques (software) to effectively combine information obtained from the newly embedded infrared, ultrasound, and stereo-camera-based sensor systems (hardware) that are implemented into the VIS4ION platform.

The core of this technology is based on 4 components: (1) a wearable vest with several distinct range and image sensors embedded. These sensors extract pertinent information about obstacles and the environment, which are conveyed to (2) a haptic interface (belt) that communicates this spatial information to the end-user in real-time via an intuitive, ergonomic and personalized vibrotactile re-display along the torso. (3) A smartphone serves as a connectivity gateway and coordinates the core components through WiFi, bluetooth, and/or 4G LTE, (4) a headset that contains both binaural, open-ear, bone conduction speakers (leaving the ear canal patent for ambient sounds) and a microphone for oral communication-based voice recognition during use of a virtual personal assistant (VPA).

Blindfolded-sighted, and blind subjects in a real-world, combined obstacle avoidance / navigation task will serve as an independent measure of overall improvements in the system as well as a roadmap for future avenues to enhance performance.

Further, a prospective, randomized crossover, controlled, non-blinded phase will be conducted in Thailand as part of this study to compare and evaluate effectiveness of the wearable vest for increasing navigation and quality of life.

Conditions

• Visual Impairment

Interventions

BEHAVIORAL

Standard object battery and training sequence

Used to examine human localization and identification performance. Object battery will include: trip hazards ('pucks' with various height/width combinations to represent children's toys, street debris, rocks, pets, etc.), furniture (chairs, desks, couches, benches), people, walls, and corridors. Objects will be recorded by placing them to the right or left on the path-of-travel. Raw sensor outputs for single obstacles and walls in isolation (trip-hazard pucks with 8 heights, chair, desk, person, wall) and the same set of single obstacles against a wall. This set of 23 raw sensor traces can be used in various combinations (e.g., encountering a curb and then a person, or a chair) to create a training sequence that will help experimentally naïve subjects to understand the correspondence between tactile stimulation and the real-world scenario it is intended to depict.

DEVICE

VIS4ION System

When in "Assistive Mode," participants will navigate campus while receiving navigation assistance (acquiring data and simultaneously providing assistance/audio feedback). When in "Passive Mode," participants will navigate campus wearing the backpack without receiving navigation assistant.

Sponsors & Collaborators

• NYU Langone Health

  lead OTHER

Principal Investigators

• John R Rizzo, MD · NYU Langone Health

Study Design

Allocation

NON_RANDOMIZED

Purpose

TREATMENT

Masking

NONE

Model

PARALLEL

Eligibility

Min Age

18 Years

Max Age

80 Years

Sex

ALL

Healthy Volunteers

Yes

Timeline & Regulatory

Start

2017-07-26

Primary Completion

2023-06-02

Completion

2024-07-23

Countries

• United States
• Thailand

Study Locations