Sensor instrument with Pure Data patch controlled by Leap Motion controller, which takes hand and finger motions and coordinates as inputs to control the sound and volume, while outputs a composition of organ, beeping, dialing tones and other sound samples.
Screen recording of Y2.02K performance along with Leap Motion Visualizer
- Move the palm in X, Y, and Z directions
- Open/Close the palm
- Circle/Swipe/Kep Tap/Screen Tap
- Number of Fingers:
Considering the possible glitches of sensor failures, I deliberately chose to have a consistent organ sound throughout.
- Y Coordinates:
The pitch of the organ.
- X Z Coordinates:
The XZ-plane was divided into 16 sub-sections and each has either sample or oscillator sound that will play once the palm position triggers.
- Finger Count:
It tweaks the oscillators in the organ.
- Sphere Radius:
It represents the volume control. Volume is high when you open the palm and low when you close it.
- Circle, Swipe, Key Tap and Screen Tap:
Either will generate a random dial sound.
Leap Motion: the technology of yesterday! I have been fascinated with gestural controlling for quite a while and this is the first time using this sensor, which tracks hand movements and collects data.
In this project, it tracks:
- Palm position
- Sphere Radius
- Finger Count
- Key Tap
- Screen Tap