Marco Buongiorno Nardelli
Research project
Beautiful Data: from virtual navigation of large data spaces to a post-sonification esthetics
Project summary
In my residency I will pursue science-art projects within a broad experimentation at the crossroads of research and art, such as data sonification, multimodal sound, and music and image interactions.Perceptualization of scientific data through sound and its value as a cognitive tool in relation to visual representations of big data; and the design of augmented/virtual reality environments for data space navigation (in collaboration with Patrice Le Gal (IRPHE), Javiera Tejerina-Risso (PRISM/IRPHE) and Richard Kronland (PRISM): What should be sonified? Why sonify? and How to sonify? in the context of large scientific datasets. During my residency I will be working towards sonification protocols as components of the multidimensional and multisensory navigation of large data sets using virtual reality applications, and in the quantification of the reliability of different visual and aural representations in psychoacoustic tests. Theis project is meant to exploit the dual aspect of data sonification, the analytic and the artistic, and provide open source software tools for a novel approach to the dialogue between perceptualization of scientific data and artistic creation: a new computer-aided data-driven composition environment for the sonification, remix and artistic reinterpretation of large data spaces as expressive media.