Kinect Face Tracking demo with mouth control - Skulls App

Gamestudio Links

Zorro Links

Newest Posts

zorro 64bit command line support
by 7th_zorro. 04/20/24 10:06

StartWeek not working as it should
by jcl. 04/20/24 08:38

Data from CSV not parsed correctly
by jcl. 04/20/24 08:32

Zorro FIX plugin - Experimental
by jcl. 04/20/24 08:30

folder management functions
by VoroneTZ. 04/17/24 06:52

♪♫♪ [For hire] VOLKOVSTUDIO - Music, SFX, Voice over, implementa
by Volkovstudio. 04/16/24 09:54

lookback setting performance issue
by 7th_zorro. 04/16/24 03:08

Zorro FIX plugin - Experimental
by flink. 04/14/24 07:46

AUM Magazine

Latest Screens

Who's Online Now

3 registered members (7th_zorro, Aku_Aku, 1 invisible), 579 guests, and 1 spider.

Key: Admin, Global Mod, Mod

Newest Members

EternallyCurious, howardR, 11honza11, ccorrea, sakolin
19047 Registered Users

Print Thread

Rate Thread

Kinect Face Tracking demo with mouth control - Skulls App #409572
10/19/12 11:37 10/19/12 11:37

5 Images

Joined: Dec 2011
Posts: 16
Valencia, Spain

ParadoxStudio Offline

OP
Newbie

Kinect Face Tracking demo with mouth control - Skulls App

Paradox D&D wanted to take the opportunity to try the new features that Kinect provides. This time, Face-Tracking.
With this excuse, we developed "Skulls", an aplication with Face Tracking which positions a 3D skull and replaces the user's head. In addition to Face Tracking, has also been used the video capture image to provide a "natural augmented reality", using the user's own body for referencing 3D models.

The Skulls application provides 3 types of heads options: skull bone, skull radiography and skull in flames (based on Ghost Rider's comic). Furthermore, a controller is added to the user's mouth so that it can open and close the skull's jaw. This application is an example of a new technology that offers many possibilities and is in the line of "virtual dressers" (in which the user "wears" 3D elements: dresses, costumes, accessories, etc..).

The application was developed on Game Studio A8, with a own Kinect plugin.

VIDEO DEMO

For more information and demos, please visit: www.pdxstudio.com

7 Comments

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: ParadoxStudio] #409683 10/20/12 20:08 10/20/12 20:08
Joined: Sep 2003 Posts: 6,861 Kiel (Germany) Superku Senior Expert
Superku Senior Expert Joined: Sep 2003 Posts: 6,861 Kiel (Germany)	Well done, seems to work nicely! I like that you keep developing those interactive applications and plugins with Gamestudio. Btw. you could try to add one or two frames lag to the webcam output so the lag of the Skull is less noticeable. "Falls das Resultat nicht einfach nur dermassen gut aussieht, sollten Sie nochmal von vorn anfangen..." - Manual Check out my new game: Pogostuck: Rage With Your Friends

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: Superku] #409686 10/20/12 21:06 10/20/12 21:06
Joined: Sep 2003 Posts: 9,859 F FBL Senior Expert
FBL Senior Expert F Joined: Sep 2003 Posts: 9,859	I see you're having lots of fun with Kinect

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: FBL] #409733 10/21/12 18:22 10/21/12 18:22
Joined: Jul 2001 Posts: 6,904 H HeelX Senior Expert
HeelX Senior Expert H Joined: Jul 2001 Posts: 6,904	Cool stuff, Paradox! Are you using an own active appearance model or do you employ an existing one?

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: HeelX] #409790 10/22/12 11:20 10/22/12 11:20
Joined: Dec 2011 Posts: 16 Valencia, Spain ParadoxStudio OP Newbie
ParadoxStudio OP Newbie Joined: Dec 2011 Posts: 16 Valencia, Spain	Thanks guys! Yes, develop with Kinect is fun! hehe The Skull position/orientation are filtered with LERP to obtain a smooth movement because kinect raw data are rude. So the latency is for this reason, and if you delay the webcam output the final effect is annoying too... so...a dilemma :-) The Skull 3D model is from our own assets library, like shaders applied. www.pdxstudio.com

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: ParadoxStudio] #416929 02/06/13 00:49 02/06/13 00:49
Joined: Oct 2008 Posts: 513 Carlos3DGS User
Carlos3DGS User Joined: Oct 2008 Posts: 513	Paradox? Really??? As in "THE" Paradox? What?!?! I had no idea you guys were on this forum or even used 3DGS at all! Risking looking like a fanboy I just have to say... I love Paradox and Arrowhead! When you guys get together nobody in the industry can beat the innovation and eye for where to put your brains/money/effort! I especially loved Europa Univeraslis, Crusader Kings, Magika, Anno, and Extraterrestrials... and I am really looking forward to The Showdown Effect, Impire, and Dungeonland! Your profile shows you are in Valencia, Spain (relatively close to me), I always thought you guys were in sweden! Great work with the Kinect, now I'm really looking forward to seeing you develop/publish/collaborate in some multiplayer/social game with this tech in the future! Some time ago I was really blow away with some youtube videos like http://www.youtube.com/watch?v=0AFFWPkcOmE or http://www.youtube.com/watch?v=hQXCTUTYYwQ In my opinion multiplayer and MMO games with this type of technology will leave others with basic text or pre-animated "emotes" waaaay behind! Good work and keep up with the innovation! I wish you the best of luck and hope you win this new "expressive" tech race!

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: Carlos3DGS] #416934 02/06/13 02:25 02/06/13 02:25
Joined: Apr 2007 Posts: 3,751 Canada WretchedSid Expert
WretchedSid Expert Joined: Apr 2007 Posts: 3,751 Canada	Originally Posted By: Carlos3DGS Paradox? Really??? As in "THE" Paradox? What?!?! I had no idea you guys were on this forum or even used 3DGS at all! That's because these guys aren't Paradox Interactive which indeed are located in Sweden. Shitlord by trade and passion. Graphics programmer at Laminar Research. I write blog posts at feresignum.com

Re: Kinect Face Tracking demo with mouth control - Skulls App [Re: WretchedSid] #416967 02/06/13 16:30 02/06/13 16:30
Joined: Oct 2008 Posts: 513 Carlos3DGS User
Carlos3DGS User Joined: Oct 2008 Posts: 513	Originally Posted By: JustSid That's because these guys aren't Paradox Interactive which indeed are located in Sweden. So they have nothing to do with Paradox Interactive? Thanks for the clarification, when I saw "ParadoxStudio" it blew my mind! "The more you know, the more you realize how little you know..." I <3 HORUS http://www.opserver.de/ubb7/ubbthreads.php?ubb=showflat&Number=401929&page=1

Moderated by jcl, Realspawn, Spirit