Sensor instrument with Pure Data patch controlled by Leap Motion controller, which takes hand and finger motions and coordinates as inputs to control the sound and volume, while outputs a composition of organ, beeping, dialing tones and other sound samples.

GITHUB ⏎

• Gestures:

    - Move the palm in X, Y, and Z directions
    - Open/Close the palm
    - Circle/Swipe/Kep Tap/Screen Tap



• Number of Fingers:

  Considering the possible glitches of sensor failures, I deliberately chose to have a consistent organ sound throughout.



• Y Coordinates:

  The pitch of the organ.



• X Z Coordinates:

  The XZ-plane was divided into 16 sub-sections and each has either sample or oscillator sound that will play once the palm position triggers.



• Finger Count:

  It tweaks the oscillators in the organ.



• Sphere Radius:

  It represents the volume control. Volume is high when you open the palm and low when you close it.



• Circle, Swipe, Key Tap and Screen Tap:

  Either will generate a random dial sound.

Leap Motion: the technology of yesterday! I have been fascinated with gestural controlling for quite a while and this is the first time using this sensor, which tracks hand movements and collects data.



In this project, it tracks:
  - Palm position
  - Sphere Radius
  - Finger Count
  - Circle
  - Swipe
  - Key Tap
  - Screen Tap