Publications

The multi-modal installation MovieScape articulates sound, image and movement with the poetic frame of Silent Cinema. It is an immersive mixed-reality environment in which the boundaries between the real and the virtual are imprecise and ambiguous. In MovieScape, an audiovisual landscape is selected with an imaginary steering wheel that is activated when the visitor closes both fists. A sphere covered with images of silent cinema is modified with rotations and displacements that alter the succession of scenes, the musical track and the sound landscape. The interaction between perception and action/movement brings about an enactive experience in which the participant immerses in the possibilities of the silent movie. The creation of MovieScape is the result of a participatory methodology. This proposal is linked to the article “MovieScape: Audiovisual Landscapes for Silent Movie” submitted to ARTECH 2019 by the same authors.

The multimodal installation MovieScape articulates sound, image, and movement with the poetics of silent film. It is an immersive mixed-reality environment in which the boundaries between the real and the virtual are imprecise and ambiguous. In MovieScape, audiovisuals generated in real time induce the emergence of recurring motor patterns performed by the visitor. An audiovisual-scape is selected with an imaginary steering wheel that is activated when the visitor closes both fists. After this initial gesture, a sphere covered with images of the silent movie is modified with rotations and displacements that alter the sequence of scenes, music track and the sound landscape. The interaction between perception, action and movement articulates with the concept of Embodied Cognition, bringing about an enactive experience in which the participant immerses in the possibilities of the silent movie. The basic setup of the installation is presented, as well as technical aspects concerning the network communication, motion capture, sonification and visualization. A participative methodology, which is (itself) a factor of knowledge construction and artistic expression, supports the creative process of MovieScape.

This article presents an ongoing research focusing on the development of a platform for generative networked creation. That is, a process of creation in which several collaborators act on different parts during the artistic creation while a computer network integrates communication between these agents and processes generative transformations. Therefore, we established a working methodology with a group of thirteen researchers of the Interdisciplinary Nucleus for Sound Studies (NICS), Ph.D. students, postdoctoral researchers and senior researchers. Our proposal was to distribute the stages of the collaborative process in separate generative modules and develop a network architecture to enable interaction between the elements and, finally, perform a multimodal work as a result of the information flow circulating in the network.