Gamestudio Links
Zorro Links
Newest Posts
Blobsculptor tools and objects download here
by NeoDumont. 03/28/24 03:01
Issue with Multi-Core WFO Training
by aliswee. 03/24/24 20:20
Why Zorro supports up to 72 cores?
by Edgar_Herrera. 03/23/24 21:41
Zorro Trader GPT
by TipmyPip. 03/06/24 09:27
VSCode instead of SED
by 3run. 03/01/24 19:06
AUM Magazine
Latest Screens
The Bible Game
A psychological thriller game
SHADOW (2014)
DEAD TASTE
Who's Online Now
2 registered members (Imhotep, opm), 785 guests, and 4 spiders.
Key: Admin, Global Mod, Mod
Newest Members
sakolin, rajesh7827, juergen_wue, NITRO_FOREVER, jack0roses
19043 Registered Users
Previous Thread
Next Thread
Print Thread
Rate Thread
Basics of Face/Shape-Recognition #385161
10/13/11 19:59
10/13/11 19:59
Joined: Feb 2005
Posts: 3,687
Hessen, Germany
T
Tempelbauer Offline OP
Expert
Tempelbauer  Offline OP
Expert
T

Joined: Feb 2005
Posts: 3,687
Hessen, Germany
Hi

i research about analyzing images (for the study and for interest). you know, face-recognition (or haptic gesture-recognition) is meanwhile spread widely, thanks to wii and xbox/kinect

i want to dive into this amazing world. get to know basics, play around with it and (if i got good enough) implementing such a feature exemplary. for stored images or, and that would be much cooler, as a lite-c-libary (think about another way of auto-targeting, webcam-games, etc)

so i need material about it.
do you know books, papers and magazins about this topic? does someone have experience with it?
i want to start recognizing a shape, like circles (i have an image of a bacteria culture).
currently i play with filter-effects to prepare the image for a recognition (-> creating a black/white image only with the bactiera-circles). but i have no idea how to recognize the shape efficiently

Re: Basics of Face/Shape-Recognition [Re: Tempelbauer] #385165
10/13/11 21:20
10/13/11 21:20
Joined: May 2005
Posts: 2,713
Lübeck
Slin Offline
Expert
Slin  Offline
Expert

Joined: May 2005
Posts: 2,713
Lübeck
Christian did something about face recognition...
For general shape detection this might be interesting for you: http://en.wikipedia.org/wiki/Viola-Jones_object_detection_framework and maybe also check out this: http://info.ee.surrey.ac.uk/Personal/Z.Kalal/tld.html
Other than that, you may want to consider shaders or OpenCL for preprocessing and other parallelizable stuff, for much better performance. For getting a video stream, there is of course OpenCV (which also implements LOTS of algorithsms for working with the data), but I actually really like videoinput, which is just extremely easy to use.

Re: Basics of Face/Shape-Recognition [Re: Slin] #385167
10/13/11 21:50
10/13/11 21:50
Joined: Jul 2001
Posts: 6,904
H
HeelX Offline
Senior Expert
HeelX  Offline
Senior Expert
H

Joined: Jul 2001
Posts: 6,904
Yes, indeed I have experience in that field. My B.Sc. thesis was about dynamic head pose recognition from statistical facial features.

@Tempelbauer: it is necessary to know what you actually want to do, because pattern recognition is not so easy as you might think. Seriously. Most people on the net which do something in that field and post vids on YouTube are only utilizing features of packages like OpenCV or re-implementing stuff that is known to computer vision research for years. So don't be to excited wink

Slin pointed out the Viola Jones Detector, which essentially utilizes Cascaded Haar Features (not from hair.. Haar was a researcher). Haar Features work only for greyscale images and are very fast and reliable, but training them is very expensive. I used the Haar Cascades provided with OpenCV to detect (not recognize, that is a difference!) faces in images in order to normalize an image to that portion of the camera image.

Face recognition is an approach in which you, given a face image (so, detection is already done!), try to identify the person of that image, or if no person you know is associated with the face image. I used the Gabor Wavelet Transformation (GWT) and a brand-new method of Elastic Bunch Graph Matching to do that. GWT needs to have the fourier-transformed image, so, you essentially have to implement a FFT for that, all in all is such an approach not realtime-enabled.

Rotated faces (along the camera axis) and posed faces (3 degrees of freedom, in arbitrary space) is a very special problem. Most solutions don't cover rotations beyond a certain degree. I trained a network of Gabor Jets for special facial features for about 12 pan angles and 8 tilt angles on a camera-space face-pose grid, tagged all training images by hand and then I process the image against the model - it works. But this is not realtime, since it is very CPU and data driven. But it's accuracy was suprisingly high, I got for the vertical axis (tilt), even more accurate results than other leading approaches; though, the horizontal results were not promising, due to some decisions I made for which facial features to take. The Kalman-Filter almost filtered false positives out, but if the head rotated around the forward axis (which I didn't targetted, though), I got bad results.

For realtime systems, there are a list of other approaches to recognize the face pose, or facial expression. Most of them, though, are very limited, since you try to recognize for example certain lines in the face and later, you try to recover from the relative shape alignment the face pose. After researching the literature, I found most systems pretty unreliable for high angular head rotation, like between -90°...0...+90° (pan and tilt).

Since motion video covers lots of noise and errors (especially during arbitrary lightning conditions), you get much trouble with the data you recover, so, in most cases you need a filter, like the Kalman-Filter, to smooth out the generated position, pose, etc. Kalman-Filters are pretty naive, though, but easy to implement, I found them pretty reliable for linear movements and -motions.

I could provide you my bachelor thesis, if you like. The literature list contains lots of nice papers and surveys which cover the state of the art. Though, there are lots of algorithms, how to do this stuff in realtime, but don't expect much accuracy if you have high hopes.

Re: Basics of Face/Shape-Recognition [Re: HeelX] #385168
10/13/11 21:55
10/13/11 21:55
Joined: Jul 2001
Posts: 6,904
H
HeelX Offline
Senior Expert
HeelX  Offline
Senior Expert
H

Joined: Jul 2001
Posts: 6,904
Quote:
i want to start recognizing a shape, like circles (i have an image of a bacteria culture).


For preparing the image, make it grayscale and try bit-extraction on the first two high-level bits. Then use a Sobel and/or Laplace filter to extract candidates for contours and use a 4-way or 8-way contour finding algorithm to skeletize the image.

Then, geometric shapes can be easily detected with the Hough-Transformation, that is faster than creating a filter kernel with a circle and convoluting the image. In the fourier domain, convolution is faster, but this is much more complicated.

I processed some images of cells and/or bacteria, a histogramm equalization is almost all the time very beneficial, because it brings some details, which are hidden in low-contrast areas, up front.

Re: Basics of Face/Shape-Recognition [Re: HeelX] #385169
10/13/11 21:59
10/13/11 21:59
Joined: Jul 2001
Posts: 6,904
H
HeelX Offline
Senior Expert
HeelX  Offline
Senior Expert
H

Joined: Jul 2001
Posts: 6,904
Quote:
haptic gesture-recognition


If you want to track a hand, you can do the following, if you have a color image: try to make a model of skin color. I used a Bayesian Histogram (one for skin color, one for non-skin color) to approximate the probability, if a pixel covers skin or not.

The you get a skin probability image, in which you can segment with a classic approach the areas: ideally, you get the area around the head and two areas for the arm/hand. Approximate which area the hands are and feed that position (and hand size) into a tracking algorithm, to predict the positions in the next frame, that helps you as a new cue to extract the hands in the next frame.

Re: Basics of Face/Shape-Recognition [Re: HeelX] #385180
10/14/11 08:23
10/14/11 08:23
Joined: Feb 2005
Posts: 3,687
Hessen, Germany
T
Tempelbauer Offline OP
Expert
Tempelbauer  Offline OP
Expert
T

Joined: Feb 2005
Posts: 3,687
Hessen, Germany
thanks for your posts laugh

Quote:
because pattern recognition is not so easy as you might think. Seriously.

i dont think that this is easy. but i want to deal with it. in my study we have 2 courses which go in this direction, one of them this semester. so now i´m collecting information about it to have a base for my exercises

Quote:
I could provide you my bachelor thesis, if you like.

yes, this would be great laugh

Quote:

For preparing the image, make it grayscale and try bit-extraction on the first two high-level bits. Then use a Sobel and/or Laplace filter to extract candidates for contours and use a 4-way or 8-way contour finding algorithm to skeletize the image.

Then, geometric shapes can be easily detected with the Hough-Transformation, that is faster than creating a filter kernel with a circle and convoluting the image. In the fourier domain, convolution is faster, but this is much more complicated.

I processed some images of cells and/or bacteria, a histogramm equalization is almost all the time very beneficial, because it brings some details, which are hidden in low-contrast areas, up front.

i´ll do so. until now i´ve played around with some filters and adjustments (using ImageJ) to get a black/withe-image of the bacterias

Re: Basics of Face/Shape-Recognition [Re: Tempelbauer] #385249
10/15/11 11:43
10/15/11 11:43
Joined: Jul 2001
Posts: 6,904
H
HeelX Offline
Senior Expert
HeelX  Offline
Senior Expert
H

Joined: Jul 2001
Posts: 6,904

Re: Basics of Face/Shape-Recognition [Re: HeelX] #385257
10/15/11 12:44
10/15/11 12:44
Joined: Oct 2002
Posts: 806
Zapan@work Offline
User
Zapan@work  Offline
User

Joined: Oct 2002
Posts: 806
@HeelX:Super Teil!

Re: Basics of Face/Shape-Recognition [Re: Zapan@work] #385459
10/18/11 18:17
10/18/11 18:17
Joined: Feb 2005
Posts: 3,687
Hessen, Germany
T
Tempelbauer Offline OP
Expert
Tempelbauer  Offline OP
Expert
T

Joined: Feb 2005
Posts: 3,687
Hessen, Germany
echt klasse, danke laugh


Gamestudio download | chip programmers | Zorro platform | shop | Data Protection Policy

oP group Germany GmbH | Birkenstr. 25-27 | 63549 Ronneburg / Germany | info (at) opgroup.de

Powered by UBB.threads™ PHP Forum Software 7.7.1