Welcome to Fractal Forums

Community => Non-Fractal related Chit-Chat => Topic started by: ker2x on July 07, 2011, 10:57:16 AM




Title: Just bought a Kinect, first tests with the C# SDK
Post by: ker2x on July 07, 2011, 10:57:16 AM
1st test :
http://www.youtube.com/watch?v=jPqC8GpwPXc&feature=player_embedded

2nd test :
http://www.youtube.com/watch?v=u3YKNtptVaE&feature=player_embedded


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 07, 2011, 01:26:13 PM
is it out already ?!
do you have a link to a store ready !? i am very keen on this thing, because it really opens up many possibilities ( not only for fractalers ) in fact i think this thing can, if delivered with a higher resolution, and the possibility to use more than one thing to improve view angles, replace any external input devices even for a normal computer, you can use the desktop ( the real one ) as keyboard, you can use your hand as a mouse....


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: ker2x on July 07, 2011, 02:00:38 PM
The kinect itself is out since a long time ago.
There was unofficial PC (mac/linux/win) drivers/sdk almost immediatly.

Microsoft released (still in beta) an official SDK last week.
http://research.microsoft.com/en-us/um/redmond/projects/kinectsdk/


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 07, 2011, 02:35:48 PM
did you buy a kinect device with games, or is there a just USB Only Kinect Device ready to buy somewhere ?


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 07, 2011, 02:41:01 PM
righty right, i just ordered the microsoft kinect device for 99€ .... i am really excited, first test will be an interactive 2d mandelbrot kinect test :D
be prepared!


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: ker2x on July 07, 2011, 02:57:18 PM
did you buy a kinect device with games, or is there a just USB Only Kinect Device ready to buy somewhere ?

i bought it with a game a resold immediatly.
Yes, i could probably get it for cheaper elsewhere. paid 120€ at a console game shop.


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cbuchner1 on July 07, 2011, 04:21:43 PM
That is interesting. So there is a virtual touch plane in space.

I might try to implement a Multitouch interface for the 3D application we're developing here using Kinect. But first I would have to support regular touch panels.

You could try to control some fractal parameters with your hands using one of the OpenCL/GLSL based realtime renderers.
Or maybe navigate with your body ;)


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 07, 2011, 05:02:50 PM
that is the idea :D each hinge produces an additional parameter, although normalization could be tricky ( remember hairy ball theorem ? e.g. calculating an angle between 2 points can be clitchy ... ) through hybrid generation of parameters there is enough variety that can be produced, just imagine controlling 32 parameters at the same time, i can see the dancers in the disco doing nice stuff with that, i think that kinect is one of the most amazing developments in the recent years


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: ker2x on July 07, 2011, 06:03:29 PM
That is interesting. So there is a virtual touch plane in space.

there isn't any defined virtual touch plane.
But it's still very simple

the (interesting part of ) kinect  send 2 data : RGB and Depth.
RGB is a good old webcam data
Depth is a minimum of 0.85m and a maximum of 4m.
0 for unknown depth (too far, too close, mirror/window, ..)

I just wrote a few condition
Code:
for each depthPixel 
  if (depth == 0) -> black
  else if (0.85 < depth < 1) -> draw pixel in the "paint" overlay
  else -> draw pixel on BW according to distance.
done

easy, huh ? :)


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 12, 2011, 12:55:06 PM
damn i got that kinect thing now, examples are running nicely, but i am struggling right now to setting up my development enviro, installing dozens of sdks ( windows, directx, kinect, speech, xna ) i am not really fammilar with the c# way of life ... but i will get some tutorials right now, i find it a bit strange to just link to a dll to use it, but all in all i like the c# way of code, it is similar to actionscript, but a bit more mighty, and i am really disappointed that c# as well does not support multi-inheritance ( for implementing interfaces just ONE time ... ) happy coding in 2011....


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: ker2x on July 12, 2011, 11:04:16 PM
damn i got that kinect thing now, examples are running nicely, but i am struggling right now to setting up my development enviro, installing dozens of sdks ( windows, directx, kinect, speech, xna ) i am not really fammilar with the c# way of life ... but i will get some tutorials right now, i find it a bit strange to just link to a dll to use it, but all in all i like the c# way of code, it is similar to actionscript, but a bit more mighty, and i am really disappointed that c# as well does not support multi-inheritance ( for implementing interfaces just ONE time ... ) happy coding in 2011....

i suggest to read http://digitalerr0r.wordpress.com/ :)


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 12, 2011, 11:26:10 PM
thx  :educated: :hungry:


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 16, 2011, 03:52:42 PM
first test:

set up: use an array of 20 complex parameters used in the iteration loop as alternate values
max iterations: 128

each of the 20 values is then assigned a X/Y pair of the joints provided by the skeleton data

and this is what it looks like ( needs to get proper fullscreen scaling ) after ~3 hours of work
now i need to switch on fullscreen mode, and render that texture fullscreen ;)


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 16, 2011, 03:53:54 PM
right now i am using a hlsl shader for rendering the 2d fract, but next step will then be to use real 3d parameters as input :D


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 16, 2011, 07:22:31 PM
ok, first test video:
http://www.youtube.com/watch?v=wYhbTf1-OAo


Title: Re: Just bought a Kinect, first tests with the C# SDK
Post by: cKleinhuis on July 16, 2011, 07:44:47 PM
and another one with a second formula in the alternation:
http://www.youtube.com/watch?v=cNhlkl6xXrs