CINEPATH
P1ANKT0NS
ILLUMINATED BAY
Y2.02K
P5.JS
CYBERENCODE
TECHNICAL

Y2.02K


Sensor instrument with Pure Data patch controlled by Leap Motion controller, which takes hand and finger motions and coordinates as inputs to control the sound and volume, while outputs a composition of organ, beeping, dialing tones and other sound samples.




Screen recording of Y2.02K performance along with Leap Motion Visualizer



GITHUB ⏎


CONTROL

  • Gestures:

      - Move the palm in X, Y, and Z directions
      - Open/Close the palm
      - Circle/Swipe/Kep Tap/Screen Tap


  • Number of Fingers:

    Considering the possible glitches of sensor failures, I deliberately chose to have a consistent organ sound throughout.


  • Y Coordinates:

    The pitch of the organ.


  • X Z Coordinates:

    The XZ-plane was divided into 16 sub-sections and each has either sample or oscillator sound that will play once the palm position triggers.


  • Finger Count:

    It tweaks the oscillators in the organ.


  • Sphere Radius:

    It represents the volume control. Volume is high when you open the palm and low when you close it.


  • Circle, Swipe, Key Tap and Screen Tap:

    Either will generate a random dial sound.




HARDWARE

Leap Motion: the technology of yesterday! I have been fascinated with gestural controlling for quite a while and this is the first time using this sensor, which tracks hand movements and collects data.



In this project, it tracks:
  - Palm position
  - Sphere Radius
  - Finger Count
  - Circle
  - Swipe
  - Key Tap
  - Screen Tap