Multimodal Media Madness - Winter Semester 2005/2006

Update There have been some performance issues when trying to draw a video sample. Note, for the assignment, all you need
to do is show you can capture a video sample and draw it at one point (you don't need to do a long stroke like the I/O Brush example). However, you need to long strokes for static images captured from the iSight.

In this assignment, you will build a patch that allows an iSight to act as a paint brush. Instead of 'traditional' paint, you will sample your immediate surrounding for colour and texture.

Watch this video
I/O Brush is a project from MIT's Things that Think Consortia. It is a Tangible User Interface that allows a person to paint using their environment for color, texture, and video.

Your job is to replicate this project using MAX/MSP. Note, you do not have to replicate the I/O brush. You can use the mouse to simulate its interaction (e.g. taking a snapshot and painting it on a window).

There are many possibilities for this assignment. Using your previous work, you can generate multimodal interfaces. For example, while sampling a colour you could use your voice to change some aspect of the sample. As well, you could use the velocity of the iSight input to alter the incoming image. Remember, like I/O Brush, you can sample not only static images but video (and even sounds!).

This assignment is to be completed in groups of 2.

Some ideas for extra credit for this assignment:

• Discuss this with me during class.

Email an archive (.zip) of your assignment to This email address is being protected from spambots. You need JavaScript enabled to view it. before the due date. The subject of your email should be "M3 Assignment 8"; be sure to use this exact subject line as it will be used to filter assignment submissions for grading. Do not submit a patch file that has not been compressed using zip.

Your assignment archive should include all files required to run your patch. Include a short plain text README file that contains:

• the names and email addresses of all group members
• instructions on how to use your patch
• a short description of your design
• non-obvious things you did (if any)
• if you did any extra credit work, be sure to tell us what you did

It is strongly recommended that you test your submission before sending it to us. If we cannot figure how to open your submission (strange or non-obvious compression format, no README file) then you will get zero.
Be prepared to discuss your solution in the next lab.

The assignment will be graded on the following rough scale:

• 1.0 - exceptional work that clearly went above and beyond what was given on the exercise
• 2.0 - exercise was completed satisfactorily as per the assignment specification
• 3.0 - exercise was completed, but has some problems
• 4.0 - incomplete exercise
• 5.0 - little or no effort was put into the exercise

Late assignments will be graded with a penalty of 0.5 per 24 hour period after the due date.