For my final project in LIPP I set up a microphone, an overhead projector and a xylphone. The mic listens for each of the 9 notes on my xylophone (actually called a "Freenotes" by the man who makes these in Colorado). I tuned the biquad eq filters in MAX to narrow frequency bands that represent the middle of each note's fundamental, so that when MAX registered one of the notes had been struck above a certain volume threshold it would allow that column's video to pass through for the amount of time the note rung out above the threshold.
The video plays in the background on loop, waiting for it's 9 column divisions to be revealed by the user's mallet hits. The source video is the epic 1982 film Koyaanisqatsi, sped up to 5x and edited for preference.
I then mapped the 9 columns to the 9 pads of the Xylophone. All that you see is a table, the xylophone and mallets, and the microphone. The whole piece came together pretty quickly and wouldn't have been possible without the help of my professor Luke Dubois or the valuable info and user feedback from classmate Or Fleisher and ITP Research Resident Matt Romein. I am indebted to these great humans for their help!