Gamestudio Links
Zorro Links
Newest Posts
Newbie Questions
by fairtrader. 12/05/23 14:22
Zorro Trader GPT
by TipmyPip. 12/04/23 11:34
Square root rule
by Smallz. 12/02/23 09:15
RTest not found error
by TipmyPip. 12/01/23 21:43
neural function for Python to [Train]
by TipmyPip. 12/01/23 14:47
Xor Memory Problem.
by TipmyPip. 11/28/23 14:23
Training with command line parameters
by TipmyPip. 11/26/23 08:42
Combine USD & BTC Pairs In Asset Loop
by TipmyPip. 11/26/23 08:30
AUM Magazine
Latest Screens
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Tactics of World War I
Who's Online Now
3 registered members (TedMar, AndrewAMD, fairtrader), 578 guests, and 0 spiders.
Key: Admin, Global Mod, Mod
Newest Members
fairtrader, hus, Vurtis, Harry5, KelvinC
19019 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Page 1 of 4 1 2 3 4
Finger Tracking System #139051
07/01/07 16:57
07/01/07 16:57
Joined: Aug 2003
Posts: 7,439
Red Dwarf
Michael_Schwarz Offline OP
Senior Expert
Michael_Schwarz  Offline OP
Senior Expert

Joined: Aug 2003
Posts: 7,439
Red Dwarf
Hi!

The last days I have been working on a Finger Trackign system that will serve to emulate a touchscreen.

Basically the camera has a refrerence picture and then compares it with the actual captured image to make a difference picture wich in most cases is your hand or an objekt like a pen. There are several zones ich wich nothing, movement and clicking is triggered. But anyway, you will see a detailed explanation in a next video I am going to do about this.

As for, with one webcam i can only move my cursor horizontally right now. As soon as i get my hands on another webcam, I will start to write the full movement and so some sonstruction so keep the cameras at the right distance, so you basically get the better feeling of actually moving the pointer with your finger, pen, whatever.

ANd now, take a live look at my system

http://youtube.com/watch?v=BEpy7O3u-jI

Beta testers always welcome!


"Sometimes JCL reminds me of Notch, but more competent" ~ Kiyaku
Re: Finger Tracking System [Re: Michael_Schwarz] #139052
07/01/07 17:16
07/01/07 17:16
Joined: Jan 2003
Posts: 4,615
Cambridge
Joey Offline
Expert
Joey  Offline
Expert

Joined: Jan 2003
Posts: 4,615
Cambridge
hey, great work, real time image processing is not very easy. let me guess...
you're comparing the real time capture with the reference image and calculate the difference (subtracting). then you mark everything over a specific threshold as "changed". now you scan for the changed part the closest to the screen... that's where your cursor is supposed to be.
are you using any form of optimization? a median filtre? downscaling? i've noticed the "time" value, probably in ms. 180 ms would be quite good for it to run in a "bloated" language such as delphi, where you might copy all image data into arrays and conitnue processing from there... so i think you're using directx-filtres? the directshow pipeline? anything like that? assembler?

btw. i like imogen heap, great music!
keep it up, joey.

Re: Finger Tracking System [Re: Joey] #139053
07/01/07 17:26
07/01/07 17:26
Joined: Aug 2003
Posts: 7,439
Red Dwarf
Michael_Schwarz Offline OP
Senior Expert
Michael_Schwarz  Offline OP
Senior Expert

Joined: Aug 2003
Posts: 7,439
Red Dwarf
You are almost at it, close, but not right.

Im using the DirectShow pipeline. BUt I am not going to spoil so much for now. BUt most of your guessings are right

JUst wait for the explanation video


"Sometimes JCL reminds me of Notch, but more competent" ~ Kiyaku
Re: Finger Tracking System [Re: Michael_Schwarz] #139054
07/01/07 17:40
07/01/07 17:40
Joined: Jan 2003
Posts: 4,615
Cambridge
Joey Offline
Expert
Joey  Offline
Expert

Joined: Jan 2003
Posts: 4,615
Cambridge
okay

let me do one more guess: you're not checking for the closest changed part to get the position of the mouse pointer, but you're rescaling it to a one-dimensional image. that would save up processing power... here you just select the pixel which comes closest to the "changed" color....

Last edited by Joey; 07/01/07 17:44.
Re: Finger Tracking System [Re: Michael_Schwarz] #139055
07/01/07 19:19
07/01/07 19:19
Joined: Sep 2002
Posts: 8,177
Netherlands
PHeMoX Offline
Senior Expert
PHeMoX  Offline
Senior Expert

Joined: Sep 2002
Posts: 8,177
Netherlands
Woot! Very nice! You might be able to sell this stuff, off course the idea isn't exactly new, but it seems to work fine already.

Cheers


PHeMoX, Innervision Software (c) 1995-2008

For more info visit: Innervision Software
Re: Finger Tracking System [Re: PHeMoX] #139056
07/01/07 21:39
07/01/07 21:39
Joined: Mar 2004
Posts: 564
Richmond, BC, Canada
Calined Offline
User
Calined  Offline
User

Joined: Mar 2004
Posts: 564
Richmond, BC, Canada
its looking cool so far =D

what about the vertical movement?^^
are you having an idea how to do this?


take a listen on my Portfolio Site
Re: Finger Tracking System [Re: Calined] #139057
07/01/07 22:08
07/01/07 22:08
Joined: Aug 2003
Posts: 7,439
Red Dwarf
Michael_Schwarz Offline OP
Senior Expert
Michael_Schwarz  Offline OP
Senior Expert

Joined: Aug 2003
Posts: 7,439
Red Dwarf
yes, but I need a second webcam to test it


"Sometimes JCL reminds me of Notch, but more competent" ~ Kiyaku
Re: Finger Tracking System [Re: Michael_Schwarz] #139058
07/01/07 23:52
07/01/07 23:52
Joined: Oct 2004
Posts: 4,134
Netherlands
Joozey Offline
Expert
Joozey  Offline
Expert

Joined: Oct 2004
Posts: 4,134
Netherlands
How about putting the cam in the corner, this way you should be able to track in all three dimensions... theoretically hehe. In the final processed image, down and bigger finger would be shifting right, up smaller would then be shifting left, down and smaller for shifting down and up bigger for shifting up. Then left and right remain for clicking. This would require alot of fine tuning though but only one camera is needed! ^^

After this works, construct a camera which you can click on the screen corner, and this could be a very nice product hehe.

Very neat idea

Last edited by Jostie; 07/01/07 23:56.

Click and join the 3dgs irc community!
Room: #3dgs
Re: Finger Tracking System [Re: Joozey] #139059
07/02/07 01:53
07/02/07 01:53
Joined: Mar 2003
Posts: 4,264
Wellington
Nems Offline

.
Nems  Offline

.

Joined: Mar 2003
Posts: 4,264
Wellington
Thats awesome.

Re: Finger Tracking System [Re: Michael_Schwarz] #139060
07/02/07 15:42
07/02/07 15:42
Joined: Mar 2002
Posts: 1,774
Magdeburg
F
FlorianP Offline
Serious User
FlorianP  Offline
Serious User
F

Joined: Mar 2002
Posts: 1,774
Magdeburg
Looks quite interessting, but doesnt the webcam hurts your LCD?^^

@justie: the camera captures just two diemensons but in the corner it would also be impossible to get the 3rd diemensional depth

Last edited by FlorianP; 07/02/07 15:49.

I <3 LINQ
Page 1 of 4 1 2 3 4

Gamestudio download | chip programmers | Zorro platform | shop | Data Protection Policy

oP group Germany GmbH | Birkenstr. 25-27 | 63549 Ronneburg / Germany | info (at) opgroup.de

Powered by UBB.threads™ PHP Forum Software 7.7.1