My left hand plays drum and My head controls the frequency
right hand plays the piano. of sound sythesizing.Virtual Instrument
Description
A gesture-controled new interface for music expression: I use the web camera as the interface to control the drum, piano and sythesizer remotely.
Snapshots
Live Demo
Technical Notes
This system is designed on the MAX/JITTER platform. The web camera can track the position of a person’s two hands and head. Those information of the positions will be transmitted to the computer. According to the different positions of those parts, the player can hear the drum beating, piano playing and sound synthesizing.