Kinect for Creative Development with open source frameworks Kinect for Creative Development with open source frameworks"

 Kinect for Creative Development with open source frameworks
Resources Kinect Common Bridge
Cinder.
openFrameworks . 
K4W v2 SDK.  
KCBv2.
oFWinrtDemo

Ben Lower Kinect Community Evangelism Kinect for Windows in 5 Minutes. - ppt download

 1 Ben Lower Kinect Community Evangelism Kinect for Windows in 5 Minutes

2 Kinect v2 Sensor Overview Demo: Kinect Evolution (Kinect Data Sources) Helpful Resources Agenda

3 Wider field of view (horizontally and vertically) for depth and color 3x depth fidelity 1080p, HD color camera (30fps) Lighting independent IR (30 fps) Improved microphones (zero balanced) 25 skeletal joints for six people -> Bio correct skeletal joints (particularly hips/shoulders/spine) plus more points and rotations Thumb tracking, end of hand tracking, Open/Closed Improved range ->.5M near, 4.5M far (extended depth to 8M) Kinect v2 Sensor Features

4 Image: iFixit,

http://www.ifixit.com Sensor Components Power Light RGB Camera IR Emitters Depth Sensor Microphone Array

5 Demo

6
 Kinect Resources K4W v2 SDK -> http://aka.ms/k4wv2sdk
 Kinect Common Bridge
->
 http://aka.ms/KCBv2
 Cinder
->
 http://aka.ms/CinderKCBv2
 openFrameworks
 ->
 http://aka.ms/oFKCBv2
Creative Coding Setup
 ->
 http://aka.ms/k4wccsetup
 Metrilus Finger Tracking
->
 http://aka.ms/aiolosk4wv2
 SDK & Libraries 7 Hours of Deep Content ->
http://aka.ms/k4wv2jumpstart
 VGB Deep Dive ->
http://aka.ms/k4wv2vgbdeepdive
 Windows Store oF ->
 http://aka.ms/OFWinrtDemos
 Developer Forums ->
http://aka.ms/k4wv2forum
 Tutorials, Content, Support Forum Purchase Sensor ->
http://aka.ms/k4wv2purchase General Info & Blog ->
http://kinectforwindows.com
 Events, Sensors, General Info @KinectWindows, @benlower We want your feedback and pull requests! Thank You! Adapter now available! (Use your Xbox One sensor)

///////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////////
Kinect for Creative Development with open source frameworks"

Presentation on theme: "Kinect for Creative Development with open source frameworks"— Presentation transcript:

1 Kinect for Creative Development with open source frameworks
Olivier Bloch – MS Open Tech Eric Mittelette – MS Open Tech Rick Barraza - Microsoft

2 Microsoft, open source and creative development

3 Microsoft Open Technologies DX Kinect for Windows
Who are we? Microsoft Open Technologies DX Kinect for Windows

4 Working in the open for and with Creative devs
ANGLE project openFrameworks openCV Cinder Boost, Cmake Bullet Box2D Cocos2D-x And more…

5 openCV on Windows Phone openFrameworks for Windows devices Cocos2D-x
Demos openCV on Windows Phone openFrameworks for Windows devices Cocos2D-x

6 Introducing Kinect for Windows v2
What’s new?

7 16-bit IR intensity value Ambient light removed
InfraredFrameSource 512 x 424 array of pixels 30 fps 2 bytes per pixel 16-bit IR intensity value Ambient light removed From the same physical sensor as depth Not heat – different frequency People have used this for: night vision, computer vision applications that need consistent illumination like face recognition, retro reflective materials also show up very well

8 512 x 424 array of depth pixels 30 fps Range: 0.5 - 4.5 meters
DepthFrameSource 512 x 424 array of depth pixels 30 fps Range: meters Each depth pixel is a 16-bit distance in millimeters from the sensor’s focal plane

9 Different image sensor than depth 30 fps
ColorFrameSource 1920 x 1080 array of color pixels Different image sensor than depth 30 fps Will maintain brightness and quality by dropping to 15 fps in low-light Different sensor means different pixel dimensions and aspect ratio. Also has wider field of view so there will be color pixels that don’t map to depth pixels.

10 BodyIndexFrameSource
512 x 424 array of body indexes -1: No body at this pixel 0 to 5: Index of the corresponding body, as tracked by the body source 30 fps Resolution is same as depth Could detect a body moved by comparing one frame to the next Can be used directly for some background removal

11 Frame data is a collection of Body objects each with 25 joints
BodyFrameSource Frame data is a collection of Body objects each with 25 joints Each joint has position in 3D space and an orientation Up to six simultaneous bodies 30fps Hand State on 2 bodies Lean Call out thumb and fingertip, hips, skeleton leaning

12 Data is audio samples captured over a specific interval of time
AudioFrameSource Data is audio samples captured over a specific interval of time Audio data is associated with an “audio beam” A steerable “cone” of focus for audio May be automatically or manually aimed Could detect a body moved by comparing one frame to the next Can be used directly for some background removal

13 Kinect for Windows v2 new capabilities
Demo Kinect for Windows v2 new capabilities

14 Coding Kinect with openFrameworks
Some more about openFrameworks on Windows devices ANGLE project Kinect v1 Kinect Common Bridge Kinect v2 New SDK, new capabilities

15 Kinect magic with openFrameworks
Demos Kinect magic with openFrameworks

16 Resources Kinect Common Bridge http://aka.ms/KCBv2
openFrameworks Plugin Windows Store oF