The Sound of Animals
The system we propose is meant to create an on the fly soundtrack that
automatically adapts to the surroundings and the situation of the wearer.
How does that work?
Let's start at the input side(on the prototype):
* one iSight camera
* two footswitches
Now, the interesting part: How to map that to the sound...
In regular time intervals, we evaluate color mix and lighting conditions as
well as the walking speed and evenness. We map these values and thire changes
in the recent past to two dimensions: lightness and speed. These parameters
are used as input to a finite state machine with nine states that reflect all
possible combinations of our two dimensions. These states - since they do not
have an inherent meaning - are labeled with animal names.
Each state has an associated set of samples one of which will be selected in
with repect to the previous state. The samples have a fix length with some
overlap to enable fading effects.
The states:
1 jelly fish
2 snake
3 elephant
4 cat
5 dog
6 shark
7 humming bird
8 dolphin
9 eagle