|
Project name
The Whistler of Oz
Team members
Saskia Dedenbach
sas.de@web.de
233859
Christoph Lohe
clohe@web.de
218623
Juan Miguel Espinosa
Carlín
juan@espinosacarlin.com
253440
Brief
introduction
Our project
consists of a device that allows the user to mix different whistling sequences
recorded by him and associate them with four different instruments.
Both
the mixing of the sequences and the association with a certain instrument,
are done with small LEGO© pieces that are arranged on a tablet like
in the following example:
The contents
of the tablet are played in a loop fashion, so the user can realize what
the recorded sequences sound like when arranged in a certain way. By doing
this, he can easily record new sequences which have the same rhythm
than the
previously recorded ones.
The recognition
of the tablet contents is done with help of the iSight© camera placed
on the top of the tablet:
High-level
list of tasks
Recognition of the desired
arrangement on the tablet with help of the camera.
Recording and storing
of the whistled sequences.
Processing and playing
of the detected sequences by passing them through a pitch detection and
MIDI
conversion
mechanisms.
Brief
description of any specific problems/challenges
Color recognition with
the camera due to light conditions.
Audio recording in MAX/MSP
in more than one buffer.
Audio input and output
setup on MAC's MAX/MSP for doing audio recording and playing simultaneously.
Possibilities
for future work
Improvements on color
detection
Improvements on audio
processing: better pitch detection, duration detection, melody harmonization
Interface extension:
more instruments, octaves, volume controls.
List
of references
An interface for melody
input
Lutz Prechelt, Rainer Typke
June 2001
ACM Transactions on Computer-Human Interaction (TOCHI), Volume 8 Issue 2
MAX/MSP pitch detection
patch
http://web.media.mit.edu/~tristan/maxmsp.html
Visual Sequencer DIS
2 project from SS 2004
http://www-i10.informatik.rwth-aachen.de/materials/dis2/ss04/sequencer/
Links
to our MAX/MSP patches
mainControl
recordController
cameraGrabber
fluteColorDetector
fluteColorDetector
drumColorDetector
pianoColorDetector
guitarColorDetector
sequenceColorDetector
whistlingConverter
colorScanner
The ZIP file with
all the patches is here.
|
