Perceptual judgement of the relationship between musical and visual components in film.

SD Lipscomb, RA Kendall - … : A Journal of Research in Music …, 1994 - psycnet.apa.org
SD Lipscomb, RA Kendall
Psychomusicology: A Journal of Research in Music Cognition, 1994psycnet.apa.org
In this study, the authors investigate the relationship between the musical soundtrack and
visual images in the motion picture experience. Five scenes were selected from a
commercial motion picture along with their composer-intended musical scores. Each
soundtrack was paired with every visual excerpt, resulting in a total of 25 audiovisual
composites. In Experiment 1, the 16 subjects selected the composite in which the pairing
was considered the “best fit.” Results indicated that the composer-intended musical score …
Abstract
In this study, the authors investigate the relationship between the musical soundtrack and visual images in the motion picture experience. Five scenes were selected from a commercial motion picture along with their composer-intended musical scores. Each soundtrack was paired with every visual excerpt, resulting in a total of 25 audiovisual composites. In Experiment 1, the 16 subjects selected the composite in which the pairing was considered the “best fit.” Results indicated that the composer-intended musical score was identified as the best fit by the majority of subjects for all conditions. In Experiment 2, the 15 subjects rated all 25 composites on semantic differential scales. A significant interaction (p<. 00005) between audiovisual combination and the various semantic differential scales was found. Analysis of this interaction revealed that the composer-intended combination yielded higher mean scores in response to the 4 adjective pairs of the Evaluative dimension. Clustering the subject responses into 2 factor scores (Evaluative vs. a hybrid of Activity and Potency), confirmed these high Evaluative mean scores. In addition, the response contours of the Activity/Potency dimension remained relatively consistent, suggesting that music exercises a strong and consistent influence over the subject responses to an audiovisual composite, regardless of visual stimulus. The results corroborate previous research, indicating that a musical soundtrack can change the “meaning” of a film presentation. Comparison of the various soundtracks in music theoretical terms assisted in identifying musical elements that appeared to be relevant to specific subject ratings. These comparisons were utilized in the formulation of a model for music communication in the context of the motion picture experience.
American Psychological Association