Sonification Data Collection

<p>In this section you find descriptions and audio examples for sonifications developed in SonEnvir. Additional sonifications have been developed during the Science By Ear workshop.</p> <UL> <LI>IEM: Juggling Sounds, Landscape-Sonification <LI>Neurology: EEG screening and realtime monitoring <LI>Physics: Numerical Spin Models, Baryon Spectra, Chaotic double pendulum, Lattice QCD <LI>Sociology: LogData, Magellan, Wahlgesaenge [Election Songs] <LI>SPSC: Logistic Equation, LUIS (Environmental Data), Time Series Experiment <LI>SBE-Workshop: Rain Data; Electrical Power Systems; EEG Rhythms; Global Social Data; Ising Model; Ultra wide band Communication; Polysaccharides </UL>

Science by Ear workshop - sonification designs by Christopher Frauenberger — last modified 2007-07-09 02:44

In this workshop, held at the IEM in March 2006, experts in sonification, audio programming and various application domains were working on seven problem sets. In team sessions they developed sonifications to problems as diverse as load flow in electrical systems, EEG rhythms, global social data, rain data for the Alpes, Ising model data, ultra wide band communication and biological materials.

Baryon Spectra (Physics) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Bianka Sengl, Willibald Plessas, Alberto de Campo, Katharina Vogt)</i></p> <p>Baryon Spectra describe the energy levels of baryons, like protons or neutrons. These spectra may be calculated within the framework of quantum chromodynamics, in so-called constituent quark models (CQMs). We sonified data stemming from several CQMs. Two different tools allow to study different aspects of these models. The sonification consisted in mappings of the (discrete) data to pitch and allowing to interactively choose different particles. Also, one may change from a melody-mode to a spectrum-mode, and change attac, sound and other auditory parameters.</p> <p><i>physics; quantum chromodynamics; constituent quark models; interactive sonification</p></i>

Chaotic double pendulum (Physics) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Katharina Vogt, Till Bovermann)</i></p> <p> This project was done within a computational physics course at the institute for physics in Graz. It simulates the movements of two simple pendulums, that are oscillating in a plane, one being fixed on the other. Depending on the initial conditions, the system behaves regularly or chaotic. We sonified the four coordinates, that are necessary to describe the system completely, by mapping them onto amplitude and pitch of two channels. Also a rhythm sonification was done. </p> <p><i> physics; chaos; chaotic systems; differential equations; double pendulum; phase space </i></p>

EEG (Neurology) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Alberto de Campo, Annette Wallisch)</i></p> <p>At our neurological partner institution (University Clinic for Neurology, LKH Graz), two routine tasks come up in everyday work where sonification is potentially useful: Fast screening of long-time EEG recordings, and realtime monitoring during so called „video EEG“ recording sessions. For these special purposes, we designed two different sonification players: An EEG Screener using simple audification and an EEG Realime-Player using a special Sonification design.</p> <p><i> neurology; sonification of EEG data; screening; realtime monitoring; data analysis; audification </i></p>

Juggling Sounds by Till Bovermann — last modified 2007-07-09 02:44

<p> <i>(Till Bovermann, Jonas Groten, Alberto de Campo, Gerhard Eckel) </i> </p> <p>Design and development of a system for realtime auditory monitoring of juggling patterns.</p> <p><i>sports; interaction; interactive sonification; direct interaction </i></p>

Landscape- Sonification by Katharina Vogt — last modified 2007-07-09 02:44

<p><i> (Alberto de Campo, Katharina Vogt) </i></p> <p> This sonification is a method originally developed to interactively explore phase space plots. It is applied here to a simple data set stemming from a numerical simulation of a potential, modeled with Successive Over Relaxation. The basic idea is to move in a plane and hear the surrounding "landscape", e.g. slopes as rising melodies. </p> <p><i>sonification method; audio display of 3d plots; interactive exploration</i></p>

Lattice QCD (Physics) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Katharina Vogt, Till Bovermann, Alberto de Campo, Philipp Huber)</i></p> <p>In this project, 4-dimensional data of computational models stemming from quantum chromodynamical lattice calculations was sonified. The problem was a problem of data mining, as searched topological structures (instantons) are well hidden in random quantum fluctuations. We did an audification and several sonification designs that "amplified" different parts of the signal by using resonators. The 4d-space can be interactively explored with a device of 4 independent sliders.</p> <p><i>physics; lattice QCD; quantum chromodynamics; sound grain sonification; topology; multi-dimensional data mining; audification; Hilbert curve</i></p>

Log Data (Sociology) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Christian Daye, Alberto de Campo)</i></p> <p>The data for this sonification originate in a R&D project concerned with the development of a toilet system that meets the needs of older people and those with (physical) disabilities. The actual settings and changes of settings of the technical features of the prototype were recorded. For ethical reasons, the only way to evaluate the prototype was to reconstruct users' interaction with the given equipment out of these log files. The use of sonification in this context allows for a more dynamic representation and for a quicker and more intuitive analysis of sequences of events.</p> <p><i>Log data; parameter mapping; time series; event sequence analysis; dynamic representation; sociology</i></p>

Logistic Equation by Christopher Frauenberger — last modified 2007-07-09 02:44

<p><i>(Christopher Frauenberger; Katharina Vogt)</i></p> <p>The logistic equation is a model for the evolution of a population. Depending on its growth rate it behaves asymptotic, periodic or turns chaotic. This sonification aims at the classification of these states.</p> <p><i>logistic equation; chaos; dynamical systems</i></p>

LUIS (Environmental Data) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Christopher Frauenberger; Corporation with the Styrian Goverment, Department for environmental information)</p></i> <p>In this sonification of environmental data we investigated the relationship between various parameters in air pollution. The data originated from the LUIS (Landes Umwelt Informationssystem) and contains measurements of particular matter pollution and rainfall at 4 monitoring stations in and around Graz. The goal was to reveal the inherent correlation between these two parameters and observe these over the time period of a month. The sonification uses parameter mapping and beacons to perceptualise the data. </p> <p><i>rainfall; air pollution; particulate matter; parameter mapping</i></p>

Magellan (Sociology) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Christian Daye, Alberto de Campo)</i></p> <p>This sonification of global social data follows Magellan's Route around the globe. Passing most of the world's nations, it represents their demographic characteristics by sound events. It thereby combines artistic, historic, and scientific interests. This sonification was successfully submitted to the ICAD concert 2006 and premiered in the Institute of Contemporary Art, London.</p> <p><i>Social data; Magellan; sonification</i></p>

Numerical Spin Models (Physics) by Katharina Vogt — last modified 2007-07-09 02:44

<p> <i>(Katharina Vogt, Christopher Frauenberger; Alberto de Campo) </i> </p> <p>In this project, data stemming from spin models has been sonified. This allows to display more dimensions and model complex systems that are dynamically evolving and not satisfactorily visualizable. Our sonifications allow for identifying the different phases easily, independent of the dimension of the model and the number of spin states. Also one gets a first idea about the order of the phase transition. The sonification techniques used encompasses sound grains of random regions providing an overview, audification and sonifications using the data as modulator of, e.g., sine waves.</p> <p><i>physics; spin systems; numerical simulation; computational models; sound grains; audification; modulation </i></p>

Time Series Experiment by Katharina Vogt — last modified 2007-07-09 02:44

<p><i> (Christopher Frauenberger)</i></p> <p>With a series of prototypes and exploratory tools, this work investigated the use of auditory means to perceptualise higher order statistical properties of time series data. In the direct interpretation of time series data as sound wave (i.e. audification), the mean is not perceivable and the variance of the data set correlates with the loudness. However, for skew and kurtosis these relationships to perceptional dimensions were the focus of interest. </p> <p><i>signal processing, higher order statistics, audification </i></p>

Wahlgesaenge/ Election Songs (Sociology) by Katharina Vogt — last modified 2007-07-09 02:44

<p><i>(Christian Daye, Alberto de Campo)</i></p> <p>The aim of this sonification was to provide a representation of election results from the 2005 Styrian provincial parliamentary election. The mental model behind our approach to the election data was that of a journey through Styria. A map of Styria displayed on a computer screen serves as starting point. With a mouse-click, the journey can be started anywhere in "Styria". When passing communities, the election result is represented by sound. The higher this tone, the higher the percentage of the voices for the chosen party. </p> <p><i>election data; model-based sonification; multi-modal approach; interactive sonification; sociology; Styria</i></p>