“Only the contrapuntal use of sound vis-a-vis the visual fragment of montage will open up new possibilities for the development and perfection of montage. The first experiments in sound must aim at a sharp discord with the visual images.” (Sergei Eisenstein)
Media collisions as drivers of innovation for new approaches to cultural heritage
The realistic and immersive experience of a VR world is supported not only by visual representation but also by an acoustic environment.
In an immersive experience it is crucial that sound creates a sense of space.
Such methods are referred to as “immersive audio”, “3D audio” or “spatial audio” effects and are examined in the Collisions project for their applicability to concrete VR scenarios.
The project also explores how information visualization techniques can be supported by data-driven acoustic environments. The aim is to test whether and how an audio connection can be established between InfoVis and the VR application.
In this context, sound design should also be understood as a possible media bridge.
Its background is the reception model to be developed. The media breaks depicted in it will be researched from the following points of view:
extended contextualisation and auditory-based InfoVis derived from the technological interpretation and exploration of the source material. An investigation of the possible uses and applications of the sound properties of individual objects in the context of the VR environment as well as in the broader context of information visualization represents the central question for the 3D-Sound area of research.