jay silver is a researcher at MIT media lab who you may remember as one of the creators of drawdio. his latest project is an ipad app that allows users to finger paint with sound and play back the sounds by touching the painting. ‘singing fingers’ has a dead simple interface that is just a blank screen. users run their fingers over the screen drawing forms as they make noise. the application records the noise and associates each noise with the form that was drawn while it was recorded. by simply touching the painting, the user can then play back the noises they made in any sequence they choose.
http://web.media.mit.edu/~silver/