My friend Joao Leao (aka The Gray Man) was visiting so I threw something together for him to play with. Music is "Fade to Grey" by Flow.Experience (excerpt). Video shot by Joe Speaks.

A test using a Kinect point cloud as input to Dance the Body Electric. The point cloud is adaptively sub-sampled and then modified by sound analysis. This is simpler and faster than a particle system.

Video of a Virtual Reality experiment, which is using a Kinect to do head-tracking for the real-time graphics. The camera taking the video is held up to my eye as I move around in front of the rear-projection screen. The software uses the Kinect to track the position of my head relative to the screen, and generates the graphics as the objects would look from that perspective - so it appears like I am moving around real objects. The statue appears to be six feet tall and standing in front of me.

For clarity this video is shot in 2D, but the piece works in 3D using Dolby 3D glasses with dual projectors. The screen completely disappears and the items appear in space in front of the user, who can even look under and down into the bowl on the outstretched hand.

A video done as part of the application for the Kennedy Center commission that became Affectations. Three segments: 0:00) Dance the Body Electric, 2:12) First experiments with dancer tracking and mapping, and 4:11) Interactive 3D school of MrWiggles (vvvv shader by dottore).

Music: 1) Forbidden Beat/Dr. Kuch 2) Very Saxxy/Ivan Batinic & Dave Jones 3) Enosque2/Lorne Covington