|
|
Finger Tracking System
#139051
07/01/07 16:57
07/01/07 16:57
|
Joined: Aug 2003
Posts: 7,439 Red Dwarf
Michael_Schwarz
OP
Senior Expert
|
OP
Senior Expert
Joined: Aug 2003
Posts: 7,439
Red Dwarf
|
Hi! The last days I have been working on a Finger Trackign system that will serve to emulate a touchscreen. Basically the camera has a refrerence picture and then compares it with the actual captured image to make a difference picture wich in most cases is your hand or an objekt like a pen. There are several zones ich wich nothing, movement and clicking is triggered. But anyway, you will see a detailed explanation in a next video I am going to do about this. As for, with one webcam i can only move my cursor horizontally right now. As soon as i get my hands on another webcam, I will start to write the full movement and so some sonstruction so keep the cameras at the right distance, so you basically get the better feeling of actually moving the pointer with your finger, pen, whatever. ANd now, take a live look at my system http://youtube.com/watch?v=BEpy7O3u-jIBeta testers always welcome!
"Sometimes JCL reminds me of Notch, but more competent" ~ Kiyaku
|
|
|
Re: Finger Tracking System
[Re: Michael_Schwarz]
#139052
07/01/07 17:16
07/01/07 17:16
|
Joined: Jan 2003
Posts: 4,615 Cambridge
Joey
Expert
|
Expert
Joined: Jan 2003
Posts: 4,615
Cambridge
|
hey, great work, real time image processing is not very easy. let me guess... you're comparing the real time capture with the reference image and calculate the difference (subtracting). then you mark everything over a specific threshold as "changed". now you scan for the changed part the closest to the screen... that's where your cursor is supposed to be. are you using any form of optimization? a median filtre? downscaling? i've noticed the "time" value, probably in ms. 180 ms would be quite good for it to run in a "bloated" language such as delphi, where you might copy all image data into arrays and conitnue processing from there... so i think you're using directx-filtres? the directshow pipeline? anything like that? assembler?  btw. i like imogen heap, great music! keep it up, joey.
|
|
|
Re: Finger Tracking System
[Re: Joey]
#139053
07/01/07 17:26
07/01/07 17:26
|
Joined: Aug 2003
Posts: 7,439 Red Dwarf
Michael_Schwarz
OP
Senior Expert
|
OP
Senior Expert
Joined: Aug 2003
Posts: 7,439
Red Dwarf
|
You are almost at it, close, but not right. Im using the DirectShow pipeline. BUt I am not going to spoil so much for now. BUt most of your guessings are right  JUst wait for the explanation video 
"Sometimes JCL reminds me of Notch, but more competent" ~ Kiyaku
|
|
|
Re: Finger Tracking System
[Re: Michael_Schwarz]
#139054
07/01/07 17:40
07/01/07 17:40
|
Joined: Jan 2003
Posts: 4,615 Cambridge
Joey
Expert
|
Expert
Joined: Jan 2003
Posts: 4,615
Cambridge
|
okay  let me do one more guess: you're not checking for the closest changed part to get the position of the mouse pointer, but you're rescaling it to a one-dimensional image. that would save up processing power... here you just select the pixel which comes closest to the "changed" color....
Last edited by Joey; 07/01/07 17:44.
|
|
|
Re: Finger Tracking System
[Re: Michael_Schwarz]
#139058
07/01/07 23:52
07/01/07 23:52
|
Joined: Oct 2004
Posts: 4,134 Netherlands
Joozey
Expert
|
Expert
Joined: Oct 2004
Posts: 4,134
Netherlands
|
How about putting the cam in the corner, this way you should be able to track in all three dimensions... theoretically hehe. In the final processed image, down and bigger finger would be shifting right, up smaller would then be shifting left, down and smaller for shifting down and up bigger for shifting up. Then left and right remain for clicking. This would require alot of fine tuning though  but only one camera is needed! ^^ After this works, construct a camera which you can click on the screen corner, and this could be a very nice product hehe. Very neat idea 
Last edited by Jostie; 07/01/07 23:56.
Click and join the 3dgs irc community! Room: #3dgs
|
|
|
Re: Finger Tracking System
[Re: Michael_Schwarz]
#139060
07/02/07 15:42
07/02/07 15:42
|
Joined: Mar 2002
Posts: 1,774 Magdeburg
FlorianP
Serious User
|
Serious User
Joined: Mar 2002
Posts: 1,774
Magdeburg
|
Looks quite interessting, but doesnt the webcam hurts your LCD?^^
@justie: the camera captures just two diemensons but in the corner it would also be impossible to get the 3rd diemensional depth
Last edited by FlorianP; 07/02/07 15:49.
I <3 LINQ
|
|
|
|