this would be (in my mind) used if you were to make avertual reality game were the player were a sort of helmet or somthing of that nature which contained a screen so the players eyes never leaves the screen and a wirless keyboard/controler would be recomended if the player desides to do a 360 and look behind himself.

and now that i added my two cents just have to say i am really impressed you showed me something that i did not even know gamestudio was capible of congrats

Hi everybody,

I've first heard of this technic when Jonny Lee's demonstration of the inverted Wii-Remote was shown on several websites. I was truly blown away by the very natural effect this simple modification can produce. You can actually look at the screen as if you where looking out of a window. Or if you were to pass a screen like this you wouldn't be able to say if it where a screen or if there where dept to it. This combined with a pair of 3D Glasses... how cool would that be!
The guys in this video have actually gone a step further by tracking the players face and massuring the distance between the eyes. It seems to work perfectly and is much more userfriendly.
Head Tracking with ONLY a Webcam (Youtube)

I don't really see how this could be used for moving the player in a game but rather to give the (physicle) player some freedom to move around in front of the screen and get a response by the camera (change of angle). I think it could add to the overall feel of the game.

Well, my webcam is broken at the moment but as soon as I get it working agein and my (very) old 3D Relevator Glasses I will try this out and report back.


So long...
Greetz from Zürich
Hitsch

I already saw that "Face API", but I won´t be able to create something like that on my own, and they haven´t released it to the public yet.

I had this idea too and will definatly give it a try But with red/cyan glasses and not with shutterglasses.


I would integrate a compass into that hardware instead of using a webcam :P

great work slin~~~ but there is something i didn't understand:
1 how do u get the image from web-cam ?does it through the dll u made ?

2 i have seen the video of wii head-tracking and face API,and i have tried to do that in 3dgs,but i can't get the exact result(mine is not that reality,i use camera in 3dgs).after a lot of work i found that they seems not useing the "camera" like things in 3dgs,but useing some projection matrix to get image?

that makes me confused,can u or anyone give me some advice about how can i do that with lite-c?

3i didn't understand how can u recognize the brighter field?useing texture samples of shader?how to get the center point of the field?
thanks very much,and to ur great work

1) Yes, I have written a dll which helps me to get the image of my webcam into the engine.

2) If I got your question right, you will have to manipulate the projection matrix, yes.

3) I am just using some simple flood filling on the cpu as I have the image as an array of rgb values.

I hope that helps you a little.

well ,thank u very much.but i m still confused what should i do with the projection matrix in 3dgs to figur that out? the only way to change the image i know is by vertex shader......or there is some other ways to do that ? plz lead me a liite more or give me some links ?i have no idea what to search...

btw: if ur dll works u could do multi-touch with 3dgs,that will be wonderful.u can also take a look at nui.org(i not sure).there is something about how to get a better result(with some image filter)

Yes I could do multi touch especially if I would surround my camera with infrared LOD would replace its infrared filter with a filter for the visible light and put the whole thing behind my monitor

This may helps you a little:
http://msdn.microsoft.com/en-us/library/bb205353(VS.85).aspx
http://www.cs.nps.navy.mil/people/faculty/capps/iap/class2/viewing/projection.html
You will have to build an off-center projection matrix depending on the viewers position. You may also have to move the view a little for good results, but I don't really know. It isn't very easy, at least not for me and I think that you won't find too much help.
I haven't tried that yet and yes that matrix is used in a vertexshader but I would recommend you to just manipulate the engine matrices in a material or render event.

thank u slin!i think that may be the point i missed.i will try to figur it out.
but it seems difficult for me,because even u r not sure on working it out.however i will try.
thank u ~~~~

I have tried headtracking via Wiimote.

The proejction I changed using a shader, that worked fine.
Still I didn't get the real 3d feeling. I think Johnny also had some special code for the "targets" in his demo.
When I have more time again maybe I'll dig up this project again.

Looks good. Nice work Slin!