A recent study published in the journal Psychology of Music details an intriguing interaction between the auditory and visual senses. Researchers discovered that lower-pitched music tends to make people perceive visual objects as darker, while higher-pitched music leads to perceptions of brighter visuals.
Music is a constant part of our lives, often paired with visual elements in movies, advertisements, and everyday situations. For example, think about how music sets the mood in a film or how it enhances the impact of an advertisement. While it is known that music can affect our emotions and interpretations, the researchers wanted to investigate a more specific question: Does the pitch of music (how high or low it sounds) influence how we perceive the brightness of visual objects?
Past studies have shown that our senses can influence each other. For instance, ominous music can make scenes in movies feel more threatening, and upbeat music can make products in ads seem more appealing. However, there was a gap in understanding how the specific attribute of musical pitch affects visual perception. This study aimed to fill that gap.
The study involved 30 university students from South Korea, with an average age of approximately 24 years. All participants reported normal or corrected-to-normal vision and normal hearing, and two were music degree students.
Participants sat approximately 102 cm away from an LCD monitor that displayed the visual stimuli while the music played through headphones. Each visual object was paired with either a high-pitched or low-pitched musical excerpt. The brightness of each visual object was assessed by the participants on a scale from 1 (dark) to 7 (bright) after listening to the accompanying music.
The musical stimuli consisted of 80 excerpts derived and modified from a previous study to ensure they conveyed specific emotions effectively. These pieces were adjusted to either a higher or lower pitch, resulting in 40 higher-pitched and 40 lower-pitched versions. Importantly, only the pitch was altered, while other musical attributes like tempo and harmony remained constant.
For visual stimuli, 20 different visual objects were created, including figures, numbers, letters, and runes. All visual stimuli were displayed in a uniform gray color to maintain a consistent level of brightness. The visual objects were presented against a nearly white background to minimize discomfort from screen glare.
The results indicated a significant influence of musical pitch on visual brightness judgments. Lower-pitched music led to darker brightness ratings across all categories of visual stimuli, while higher-pitched music resulted in brighter ratings. Specifically, visual objects paired with lower-pitched music had an average brightness rating of around 3.2, whereas those paired with higher-pitched music were rated around 3.5.
- Figures: Visual objects were rated at an average brightness of 3.11 with lower-pitched music, compared to 3.36 with higher-pitched music.
- Numbers: Brightness ratings averaged 3.29 with lower-pitched music and 3.51 with higher-pitched music.
- Letters: Participants rated the brightness of letters at 3.22 with lower-pitched music and 3.52 with higher-pitched music.
- Runes: The average brightness rating was 3.10 for lower-pitched music and 3.44 for higher-pitched music.
The results provide empirical evidence supporting the theory that simultaneous auditory and visual cues can influence each other, leading to a more integrated sensory experience.
“These findings are consistent with prior research showing that what we hear can modulate how we visually interpret cues,” the researchers wrote. “Previous studies have focused on the effects of musical pitch across various cognitive domains, including inference, preference, and decision-making.”
“Extending these findings, this study provides valuable insights into how pitch, as a musical feature, can shape the brightness interpretation of visual experiences. Given the intertwined and concurrent nature of musical sounds and visual events in everyday life, we believe that these findings could contribute to a deeper understanding of the intricate interplay that occurs in the human brain when processing music and visual information in daily situations.”
While the study offers valuable insights, it also has limitations. The sample consisted primarily of young adults from a university setting, which may not be representative of the general population. Additionally, the controlled environment might not fully capture the complexity of real-world sensory experiences. Future research could explore these effects in more diverse populations and everyday settings, such as busy streets or virtual reality environments.
Further investigations could also examine the neural mechanisms underlying these sensory interactions using techniques like functional magnetic resonance imaging (fMRI). Understanding whether the observed effects stem from early sensory processing or later cognitive stages would provide deeper insights into how our brains integrate auditory and visual information.
The study, “Concurrent musical pitch height biases judgment of visual brightness,” You Jeong Hong, Ahyeon Choi, Chae-Eun Lee, WooJae Cho, Sumin Yoon, and Kyogu Lee.