AR/VR++ with Motion Capture System / Rhizomatiks Research


Bring the virtual world into the physical world by using multiple sensors – let’s touch walls we can’t see, and hear sounds we can’t hear.

The technology of motion capture is known for capturing human and dance movement, and recording it into databases as numerical data. Also, much of this technology is already well established and in some cases considered “old”. However, it can be repurposed into new technology by mixing with multiple systems. Rhizomatiks Research uses motion capture systems in multiple ways and situations; for example, checking a drone’s position and location, compositing robust augmented reality (AR) graphics without retro-reflective markers, and synchronizing the motion and rotation of moving objects via projection mapping. The purpose of this workshop is to develop interactive tools that allow you to experience virtual reality with motion capture system and multiple devices – like touching walls we can’t see by using an ultrasonic oscillator/vibrator, or changing music by moving space.

Software recommendation: openFrameworks, Processing.
Hardware devices and sensors: Rhizomatiks Research provides them (but bring your own if you have them).

– References

– Schedule
10.00-10.30 General Introduction
10.30-12.00 Introduction to Basic Computer Vision and Motion Capture
12:00-14.00 Introduction to Augmented Reality
14.00-17.00 Experimentation
17.00-18.00 Presentation


– Install
cycling 74 Max:
Xcode (necessary for openFrameworks on OSX)
More information will be emailed to all the participants.


– Laptop Mac.
– MacBookPro after Mid 2010
– OS OS X Mavericks 10.9 / OSX Yosemite 10.10/ OSX El Capitan 10.11
– Headphones


English / Japanese / Korean (support)

Duration: 1-Day