KINECT VFX DEV

 

 

View the Processing Kinect v1 points recorder code at github

View the blenderPython script at github

 

The goal of this project is to (re)develop the way to record 3D Mesh data from performers and to use it for content creation and motion graphics purposes in any pipeline.

I developed a script in blenderPython for importing Kinect point cloud data as vertices into blender ‘s 3D space. I am able to emit particles and smoke and create other effects using 3d information from dancers and stage artists.

I originally used Open Frameworks to record my point cloud data to a text stream.

I have updated this post to include a new Processing 3.x based recording method

For issues with kinect drivers please use Zadig found here:
https://zadig.akeo.ie/

 

smoke_demo

 

WHIRLWIND

In an attempt to create an experience that enables one to revisit their childhood feelings of curiosity and exploration. I built an interactive pinwheel with a visual counterpart. The viewer draw particles onto the surface using the pinwheel, and the can “blow them away” by blowing on the pinwheel.

Ingredients:

Max/MSP Programming, Arduino, RF send/receive modules, IR LED, one small motor for speed input.






 

DIAGONALS

I conducted research and produced an interactive scratch/touch surface and audio visual installation with IREGULAR.IO for the MCLAREN WALL-TO-WALL 2014 PROGRAM.
Produced by the NFB and Quartier Des Spectacles partnership.

For this project, I helped research different interactive surface technologies. I built the sensors for the monolith (the scratch-wall) from XLR cables and contact microphones.
Challenges included reducing feedback and noise levels and achieving good signal filtering with Max/MSP.

 

http://iregular.io/installations_scenographies/diagonales

MODULAR MATRIX

Numbering sytem

With Thierry Dumont & Pascal Champagne.

We built a hand-held light relay sculpture. The light in the tubes represent knowledge/signal and how it can only advance from module to module with the help of our interventions. To share the knowledge we must build the structures for it to move forward.

Sensor Research & Interaction Design, Concept Development, Construction and production.

 

 

Resources & Reference

@ Correlate Exhibition

DIGITAL MOIRÉ

DIGITAL MOIRE from Pascal Champagne on Vimeo.

Description: DIGITAL MOIRÉ explores how media changes shape, form and feeling once it is transfigured  onto/into another medium.

This work was inspired by Poemotion a book of “visual illusions” by Takahiro Kurashima. By overlapping video planes in Max/MSP we recreated the illusions from the book and expanded on them from a digital context. Providing viewers a destabilizing experience with the help of loud pulsing noises controlled by people’s presence and as an added sculptural element, we used wool strings to extend the light form and structure the space and viewing angle.

We made this interactive projection mapping sculpture.
using a kinect and some very simple animation techniques. The kinect senses people as they approach and thier presence aniamtes the illusions on the floor. As the number of viewers grow, the speed of the animation increases.

Contribution: Design research & Max/MSP audio/visual programming and Kinect sensor integration

More Info: http://digitalmoire.ca/

CHAINFOREST


Description: CHAINFOREST is an interactive audio-sculptural installation. Incorporating trees, stumps and branches, chains, saw dust, loud machinery noises, and for contrast, some peaceful bird songs. The goal of our user interaction is to get our users to stop the noise, to stop the machines… and hence allow the songs of the birds to be heard again…

Contribution: Concept development, design, research, resource acquisition, construction and production.

More Info: http://www.chainforest.info/

AQUEOUS


 


A water drop display concept that I am currently experimenting with and developing.

Words, stories, narrative, and modern day text messages, are something to marvel. They all seem so simple, and yet it is through these that we build narratives of ourselves. A simple stroke holds so much weight, that when joined into words worlds can be destroyed and realities creates. Without text, we would not be what/who we are, and yet text is often overlooked and ignored.

Water; it is an incredible force of nature and at the heart of life, and yet so often we overlook it. We pay little to no attention to it, yet we need it to live. It goes into creating us as a biological cell.

What would happen if these two were to collide? Could we have something that draws attention to the beauty of the two objects, these objects that are only acknowledged in brief moments of our lives and then forgotten? This is what we wish to address, by creating a feeling of suspended water messages.

Tests/research: http://jasonhendrik.com/aqueous-grapheme/
Contribution: Original concept development, research and design, programming, soldering and circuit design, construction and production, documentation

More Info: http://watermarquee.weebly.com/index.html

SURFACE EFFECTS

Surface Effects from Jason Hendrik on Vimeo.

Description: Surface Effects is an interactive experience where your position in the room affects and changes the state of the mediated environment. We mixed video-mapping with interactive sculptures and consumed a room with creative potential by providing people the means to collaboratively affect and modify their surroundings.

Contribution: Max/MSP programming, research and troubleshooting, video-mapping, interactive design, sound design, project management.

More Info: http://jasonhendrik.com/cart-312/

 

 

MOTION ACCUMULATOR

Screen shot 2013-05-12 at 4.31.50 PM

These two Max-Msp patches work together. In the main patch you will find
a particle system which listens over the network for incoming data.
Particularly data from the “MotionDetector” patch.

Team: Jason Hendrik & Thierry Dumont

MainParticles.maxpat
MotionDetector.maxpat

To generate particles or bits of light ( to add energy into the environment),
we need to be connected and active in these networked environments.

RELAY WALL

ambient light wall from Jason Hendrik on Vimeo.

Description: The ambient light wall is an exploration of message relay and networking. Through interacting with the piece, one almost gets a sense of empathy for the signal- the light can only continue if we intervene, if we guide it back to where starts.The entire pattern, the cycle of fading lights becomes stagnant without interaction, the sounds emitted from the piece are repetitive (still ambient though) and in most cases if the piece to left to its own devices it will eventually lose its “energy”.. Someone must intervene and rotate one of the wooden parts to get it going again.

The wall is built of wood, LEDs, Photocells, Arduinos, driver & multiplexer circuits, and some Max/MSP for audio.

Contribution:  Concept development, programming, Max/MSP and Arduino communication, construction and production.