¿Cambiar a Español?

SapientNitro Fireworks installation

Tags: sapientnitro prototype design kinect openni openframeworks creative-tech open-source

Source code

A Kinect-driven hand tracking experiment

This experiment aims to showcase the hand tracking capabilities of an Xbox Kinect camera connected to a computer. Using a simple vertical hand gesture recognition, the app can create multiple fireworks along the horizontal axis which get fired from the bottom of the screen.

To increase the dynamism of the experiment, the app uses random values for the colors of the fireworks, trail size, gravity, amount of particles, fading, damping, etc...

To maximize the audiovisual appeal, the app also features these techniques:

  • 2D Skybox with a seamless background texture
  • Parallax effect (some clouds moving faster than the sky)
  • Base soundtrack playing in a loop and 7 different sound effects, including a crowd of people cheering after a rich round of continuous fireworks
  • Dynamic blur effect using shaders for the hand calibration overlay

Tech used

This app has been coded in an Apple MacBook, using the Xcode IDE. The programming language used is C++ and the main library is OpenFrameworks, a set of open source tools widely used around the world for art installations and creative applications.

There are also a few OF add-ons worth mentioning:

  • ofxKinect: an API/Interface to interact with Kinect from OF
  • ofxOpenNI: a wrapper for OpenNI (for the hand tracking logic)
  • ofxBlur: for the blur functionality

All the images and sounds have been obtained from free stock repositories.

This app can be adapted to any screen size and it works in both, landscape and portrait mode. It can also work in Windows and Linux, although a Mac (with a decent CPU) is preferred due to higher support by the community.

Note: Kinect cameras cannot be connected to mobile devices or tablets, although their touch screen can be used as controllers for similar apps.

The demo was installed in Eden House’s exhibit area (SapientNitro's office) to allow visitors and employees to use it.

Wall installation
Wall installation

Before you continue...

By clicking "Accept All", you agree to the storing of cookies on your device to enhance site navigation and analyze site usage.


¿Cambiar a Español?