From visual snapshots to allocentric representations of a 3D world

NIH Pandemic-Era Grants

Pandemic Era Grants

2024

Document text

Principal Investigator: Anna  Shafer-Skelton
Organization: UNIVERSITY OF PENNSYLVANIA
Fiscal Year: 2024
Award: $74,284
Funding agency: National Eye Institute

PROJECT SUMMARY/ABSTRACT
 Spatial neuroscience has uncovered a great deal about how animals—primarily rodents—form allocentric
(world-centered) spatial maps of the world. Rodents explore by moving their bodies through the world. In
contrast, primates explore the world visually, and recent work suggests this could dramatically impact their
formation of allocentric maps. The current project investigates the brain systems that allow humans to form
allocentric maps of 3D spaces from afar, without physically visiting the locations being represented. This work
will use fMRI to detect map-like representations of viewed locations in a 3-dimensional “scene space” and to
compare these to map-like representations of visited locations in a virtual “navigable space”. This work is
divided into 2 aims, the first optimized for experimental power and the second optimized for ecological
validity. Aim 1 is to identify map-like representations of scene space and understand their
relationship to cognitive maps of navigable space. Representational similarity analysis (RSA) will be
used to quantify map-like allocentric representations of locations in scene space. Experiment 1a will identify
brain regions that support viewpoint-independent (allocentric) maps of viewed locations in scene space.
Experiment 1b will use an analogous procedure to identify brain regions that support viewpoint-independent
maps of navigable space and relate them to viewpoint-independent maps of scene space. Aim 2 is to identify
representations of scene space and navigable space using dynamic, ecologically relevant tasks.
This aim will leverage voxelwise encoding models to detect map-like neural representations of viewed and
visited locations while participants actively explore their environments. Experiment 2a will look for maps of
scene-space by scanning participants while they view the virtual courtyard from different viewpoints and
actively searching for a hidden target item. Experiment 2b will look for maps of navigable space by scanning
participants while they freely navigate through the virtual environment searching for hidden rewards. This
research will take place in the ideal training environment for the applicant. The sponsorship team's expertise in
the field of spatial navigation, advanced fMRI analysis and designs, and the computational modeling of freely-
navigating participants data are critical to the applicant's training goals. Further training is available through
coursework in machine learning and data science, computing resources, and a diverse set of relevant lab
meetings and seminars. This work addresses a critical gap in the literature between the fields of vision science
and spatial neuroscience. Understanding the role of the visual system in forming spatial maps in sighted
individuals could inform interventions aimed at mitigating navigational and other challenges faced by those
with low vision or other differences in sensory processing.

Terms: <3-D><3-D world><3-Dimensional><3-dimensional world><3D><3D world><AD dementia><AD/HD><ADHD><ASD><Address><Alzheimer Type Dementia><Alzheimer disease dementia><Alzheimer sclerosis><Alzheimer syndrome><Alzheimer's><Alzheimer's Disease><Alzheimers Dementia><Animals><Apoplexy><Area><Assistive Technology><Attention deficit hyperactivity disorder><Autism><Autistic Disorder><Back><Brain><Brain Nervous System><Brain Vascular Accident><Brain region><Cerebral Stroke><Cerebrovascular Apoplexy><Cerebrovascular Stroke><Cognitive><Comment><Commentary><Computer Models><Computerized Models><Data><Data Science><Degenerative Neurologic Disorders><Detection><Diagnosis><Diminished Vision><Dorsum><Early Infantile Autism><Editorial Comment><Encephalon><Environment><Fixation><Foundations><Functional MRI><Functional Magnetic Resonance Imaging><Goals><Human><Image><Impairment><Individual><Infantile Autism><Intervention><Intervention Strategies><Kanner's Syndrome><Knowledge><Link><Literature><Location><Low Vision><Machine Learning><Maps><Modeling><Modern Man><Nervous System Degenerative Diseases><Neural Degenerative Diseases><Neural degenerative Disorders><Neurodegenerative Diseases><Neurodegenerative Disorders><Neurologic Degenerative Conditions><Neurosciences><Outcome><Partial Sight><Participant><Perception><Predominantly Hyperactive-Impulsive Type Attention-Deficit Disorder><Predominantly Hyperactive-Impulsive Type Hyperactivity Disorder><Primary Senile Degenerative Dementia><Primates><Primates Mammals><Procedures><Process><Published Comment><Reduced Vision><Research><Rewards><Rodent><Rodentia><Rodents Mammals><Role><Scanning><Self-Help Devices><Sensory><Shapes><Sight><Stroke><Subnormal Vision><System><Testing><Training><Viewpoint><Vision><Visit><Visual><Visual System><Visual impairment><Visuospatial><Work><assisted device><assistive device><autism spectral disorder><autism spectrum disorder><autistic spectrum disorder><brain attack><cerebral vascular accident><cerebrovascular accident><classroom environment><college atmosphere><collegial atmosphere><collegiate atmosphere><computational modeling><computational models><computational resources><computer based models><computerized modeling><computing resources><degenerative diseases of motor and sensory neurons><degenerative neurological diseases><design><designing><education atmosphere><educational atmosphere><educational environment><experiment><experimental research><experimental study><experiments><eye tracking><fMRI><falls><gaze><imaging><intellectual atmosphere><interventional strategy><learning atmosphere><learning environment><machine based learning><medial temporal area><medial temporal lobe><meeting><meetings><mesial temporal area><mesial temporal lobe><natural aging><neural><neurodegenerative illness><normal aging><normative aging><novel><performance tests><primary degenerative dementia><rehab strategy><rehabilitation strategy><sample fixation><school atmosphere><school climate><senile dementia of the Alzheimer type><social role><spatial navigation><stroked><strokes><three dimensional><three-dimensional world><training atmosphere><university atmosphere><virtual><virtual environment><vision impairment><vision science><visual function><visual science><visual spatial><visual tracking><visually impaired><way finding><wayfinding>