The brain remembers sights and sounds differently, study reveals

by Baycrest Centre for Geriatric Care

edited by Gaby Clark, reviewed by Andrew Zinin

Gaby Clark

Scientific Editor

Meet our editorial team
Behind our editorial process

Andrew Zinin

Lead Editor

Meet our editorial team
Behind our editorial process Editors' notes

This article has been reviewed according to Science X's editorial process and policies. Editors have highlighted the following attributes while ensuring the content's credibility:

fact-checked

peer-reviewed publication

trusted source

proofread

The GIST Add as preferred source

New Baycrest research reveals that the brain remembers what we see and what we hear in different ways. Visual memories tend to retain fine details, while auditory memories are more likely to preserve the overall meaning of an experience. The findings shed new light on how the brain reconstructs memories and could help inform future approaches to learning, aging and rehabilitation.

"For years, research has shown that we remember what we see and what we hear differently, but this study is among the first to show the brain mechanisms behind that difference," says Dr. Lei Zhang, a postdoctoral fellow at Baycrest's Rotman Research Institute and lead author of the study, which was conducted with co-senior authors Dr. Claude Alain and Dr. Bradley Buchsbaum. "Our research opens the door to understanding not just how memory works, but how we might better support it across different contexts, from learning to aging."

The study, titled "Different Reliance on Sensory Reinstatement and Internally Transformed Representations during Vivid Retrieval of Visual and Auditory Episodes," was published recently in The Journal of Neuroscience.

The study found that while both visual and auditory memories rely on a process known as "reinstatement" (in which the brain reactivates patterns from the original experience), the brain emphasizes different kinds of information depending on what is being remembered. Visual memories tend to preserve more detailed traces of the original experience, while auditory memories rely more heavily on reconstructed meaning-based information, or "gist."

Main study findings include:

• Both visual and auditory memories reactivate brain activity patterns linked to the original experience, with stronger reactivation associated with more vivid recall.
• Visual memories preserve more perceptual detail, while auditory memories rely more on reconstructed meaning-based information.
• The brain uses overlapping but differently weighted systems to process memories of sight and sound.

Functional magnetic resonance imaging (fMRI) was used to examine how 25 young adults learned and later recalled naturalistic soundscapes and video clips while their brain activity was recorded. Participants were presented with short audio and video clips arranged in pairs, allowing one clip to later serve as a cue to prompt recall of the other. During memory testing, participants were shown the cue clip and asked to mentally reconstruct its paired match. After each trial, participants rated how vivid their memory was.

Researchers analyzed participants' brain activity during both learning and recall to compare how visual and auditory memories are formed and reconstructed. The analysis showed that both types of memories reactivated patterns in higher-order sensory regions of the brain when participants recalled past experiences. In other words, the brain partially "replayed" elements of the original experience during retrieval for both sight and sound.

However, the strength and nature of this replay differed across sensory systems. Visual memories were more closely tied to detailed perceptual information, while auditory memories relied more heavily on internally reconstructed meaning-based representations. The findings suggest the brain uses a shared memory system for both sight and sound but prioritizes different forms of recall depending on the sensory experience.

This is one of the first studies to directly compare how the brain reconstructs memories across sight and sound at the neural level.

"The findings may eventually help researchers better understand how memory changes with aging, how people learn most effectively and how rehabilitation strategies can be tailored for individuals with memory impairment," says Alain, a senior scientist at Baycrest's Rotman Research Institute. "The study also opens the door to future research exploring whether auditory memory's emphasis on meaning may offer advantages for long-term retention."

Publication details

Lei Zhang (张磊) et al, Different Reliance on Sensory Reinstatement and Internally Transformed Representations during Vivid Retrieval of Visual and Auditory Episodes, The Journal of Neuroscience (2026). DOI: 10.1523/jneurosci.1576-25.2026

Journal information: Journal of Neuroscience

Key medical concepts

Functional MRI

Clinical categories

NeurologyPsychology & Mental health Provided by Baycrest Centre for Geriatric Care Who's behind this story?

Gaby Clark

MA in English, copy editor since 2021 with experience in higher education and health content. Dedicated to trustworthy science news. Full profile →

Andrew Zinin

Master's in physics with research experience. Long-time science news enthusiast. Plays key role in Science X's editorial success. Full profile →

Citation: The brain remembers sights and sounds differently, study reveals (2026, June 23) retrieved 23 June 2026 from https://medicalxpress.com/news/2026-06-brain-sights-differently-reveals.html This document is subject to copyright. Apart from any fair dealing for the purpose of private study or research, no part may be reproduced without the written permission. The content is provided for information purposes only.