VIS4ION (Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation)

NIH Pandemic-Era Grants

Pandemic Era Grants

2024

Document text

Principal Investigator: John Ross  Rizzo
Organization: NEW YORK UNIVERSITY SCHOOL OF MEDICINE
Fiscal Year: 2024
Award: $264,010
Funding agency: National Eye Institute

PROJECT SUMMARY/ABSTRACT 
Visual impairment causes significant losses to mobility, independence, and quality of life, contributing to elevated rates of anxiety, depression, and physical injuries, inclusive of mechanical trips and falls. These challenges are compounded in complex urban environments, such as large healthcare centers and multi-use city blocks, where navigation requires advanced spatial cognition. To address this gap, our team has developed VIS4ION (Visually Impaired Smart Service System for Spatial Intelligence and Onboard Navigation), a customizable, human-in-the-loop wearable and smartphone application delivering real-time wayfinding assistance using next-generation mapping and localization technologies.
Our central hypothesis is that infrastructure-independent wearable navigation technologies can improve spatial cognition, mobility, and well-being for people with visual impairments. Building on promising R21 outcomes—including improved navigation efficiency and user confidence, along with high acceptability—we will conduct extended trials across NYU Langone Health hospital facilities and the Lighthouse Guild, a storied blindness-focused NPO headquartered in NYC, as well as surrounding multi-block outdoor environments across the NYC-metro region.
This project has five aims:
1.	Develop and refine an enhanced navigation system with real-time image-based localization, IMU integration for step-counting navigation, and advanced scene understanding through AI.
2.	Digitally map complex multi-floor healthcare facilities and surrounding urban areas using innovative, infrastructure-free digital-twinning techniques.
3.	Assess acceptability, appropriateness, feasibility, and usability through focus groups and user-centered design testing with visually impaired participants.
4.	Conduct an extended-use trial to evaluate system effectiveness on longer-range navigation performance.
5.	Validate generalizability of the navigation system at-scale across multi-block NYC environments, testing across diverse indoor and outdoor settings.
By combining advanced mapping, robust localization, and iterative human-centered design, this project will provide a scalable, cost-effective wayfinding solution to improve independence, safety, and quality of life for people with visual impairments across the U.S.

Terms: <3-D><3-D world><3-Dimensional><3-dimensional world><3D><3D world><Access to Information><Address><Adverse Experience><Adverse event><Anxiety><Area><Benchmarking><Best Practice Analysis><Bionomics><Blind Students><Blindness><Body Buffer Zone><Cell Body><Cell Communication and Signaling><Cell Signaling><Cells><Cities><Cognition><Complex><Computer Vision Systems><Computer software><Country><Cues><Data><Data Bases><Databases><Debility><Dimensions><Diminished Vision><Disparate><Ecology><Economic Burden><Economic Income><Economical Income><Elements><Employment><Enhancement Technology><Ensure><Environment><Fear><Feedback><Focus Groups><Foundations><Fracture><Freedom><Fright><Health><Health Promotion><Home Ranges><Image><Immobilization><Income><Individual><Infrastructure><Intelligence><Intervention><Intervention Strategies><Intracellular Communication and Signaling><Investigators><LMIC><Length><Liberty><Location><Low Vision><Low-resource area><Low-resource community><Low-resource environment><Low-resource region><Low-resource setting><Maps><Mechanics><Mental Depression><Modeling><Outcome><Partial Sight><Participant><Performance><Personal Satisfaction><Personal Space><Phase><Physical activity><Population><Position><Positioning Attribute><Premature Mortality><Privacy of Space><Process><QOL><Quality of life><Reduced Vision><Research><Research Personnel><Research Resources><Researchers><Resource-constrained area><Resource-constrained community><Resource-constrained environment><Resource-constrained region><Resource-constrained setting><Resource-limited area><Resource-limited community><Resource-limited environment><Resource-limited region><Resource-limited setting><Resource-poor area><Resource-poor community><Resource-poor environment><Resource-poor region><Resource-poor setting><Resources><Risk><Salutogenesis><Semantics><Services><Signal Transduction><Signal Transduction Systems><Signaling><Software><Students><Subgroup><Subnormal Vision><System><Techniques><Technology><Testing><Thailand><Time><Travel><Unemployment><Universities><Visual disability><Visual impairment><Visually Impaired Persons><Visually Impaired Students><Visually disabled><WiFi><amateur science><amateur scientists><assess effectiveness><benchmark><biological signal transduction><blind individual><blind people><bone fracture><citizen science><citizen scientists><civic science><cohort><college><collegiate><computer vision><cost><crowd science><crowd-sourced science><data base><depression><determine effectiveness><digital twin><disability><effectiveness assessment><effectiveness evaluation><effectiveness testing><evaluate effectiveness><examine effectiveness><experience><falls><fear of falling><functional assistance><functional improvement><higher education><human-in-the-loop><imaging><improve function><improved><improved functional outcomes><improved mobility><improved outcome><incomes><innovate><innovation><innovative><interventional strategy><jobless><joblessness><knowledge base><long bone><low and middle-income countries><mechanic><mechanical><mobility enhancement><mobility improvement><new approaches><next generation><novel><novel approaches><novel strategies><novel strategy><optimized mobility><orthopedic freezing><out of work><outreach to information><patient centered><patient oriented><process evaluation><promoting health><psychosocial><psychosocial outcome><psychosocial sequelae><reconstruction><satisfaction><scientific citizenship><sensor><socio-economic><socio-economically><socioeconomically><socioeconomics><spatial navigation><three dimensional><three-dimensional world><unemployed><urban area><urban location><urban region><usability><vision disability><vision impairment><vision loss><visual loss><visually impaired><way finding><wayfinding><wearable><wearable device><wearable electronics><wearable system><wearable technology><wearable tool><wearables><well-being><wellbeing><wi-fi><wireless fidelity>