SimplyMaya Forums

Welcome to the forum, feel free to ask questions here.

Home / forum / Lounges / Members Lounge / MOCAP systems
Register FAQ Members List Calendar Mark Forums Read

New Thread
 
Thread Tools
Old 20-04-2012, 01:44 PM   #1
cgisoul
Lifetime Member
 
cgisoul's Avatar
 
Join Date: Apr 2011
Posts: 258
Thanks: 22
Thanked 37 Times in 36 Posts
Default MOCAP systems

Hi,

For the last few days I've been in the hunt for a free or a not so expensive facial motion capture for my own personal project. One thing besides testing the different systems, I also love doing the research (whatever interests me, in this case MOCAP).

After discovering the ipisoft DMC that does full body motion capture, in which, I did a short tutorial explaining the workflow at Maya to ipisoft back to Maya - Part 1 ( Creating HumanIK ) - YouTube

I am now in the hunt for a facial motion capture system / software. Thinking to add a facial motion to my Alien (the one shown in my avatar or http://www.mduque.com

During my research I came across few tools and tutorials that might be of your interest:


Cheap Facial Motion Capture - Introduction ( this one explains the workflow in capturing your facial motion all the way to your own mesh ). I might build my own helmet this weekend or next week. That gonna be fun.

Cheap Facial Motion Capture - Introduction - YouTube


Another program that was referred to me and works with Maya is FaceWare from image-metrics at http://www.image-metrics.com/
You can download a free trial and test it with Maya. It basically analysis your video and sets key points for you in the timeline. Looking at the training videos, it looks very intuitive to use. Have installed it but haven't try it yet. I'm testing the Cheap Facial Motion Capture first now.

Another is Face Robot. This one doesn't show the MOCAP implementation, but shows you how to setup the whole Face for animation. Looking at http://softimage.wiki.softimage.com/...reOverview.htm, we might be able to add the mocap data on it. Need to figure that one out later if nothing works. The following tutorial is consisted of 16 short videos.

1 - Picking Parts and Landmarks - YouTube


We also have this FAT (Facial Animation Tools) software. You can register and after that they will send you the download link. http://research.animationsinstitut.de/44.0.html

Still researching for alternatives.

Last edited by cgisoul : 20-04-2012 at 01:49 PM.
cgisoul is offline   Reply With Quote
Old 20-04-2012, 07:41 PM   #2
daverave
The thin red line
 
daverave's Avatar
 
Join Date: Aug 2009
Location: England
Posts: 4,472
Thanks: 101
Thanked 952 Times in 879 Posts
Default

Face robot does look easy to setup, I would like to see the solution to say add mocap and face robot and animation of the hand all together. now if only I could get the 2 xboxes 360 I have in the house to help render.............dave
__________________


Avatar Challenge Winner 2010
daverave is offline   Reply With Quote
Old 20-04-2012, 08:24 PM   #3
NextDesign
Technical Director
 
NextDesign's Avatar
 
Join Date: Feb 2004
Posts: 2,988
Thanks: 33
Thanked 532 Times in 471 Posts
Default

If you had a ps3, it's possible.
__________________
Imagination is more important than knowledge.
NextDesign is offline   Reply With Quote
Old 28-04-2012, 04:29 AM   #4
cgisoul
Lifetime Member
 
cgisoul's Avatar
 
Join Date: Apr 2011
Posts: 258
Thanks: 22
Thanked 37 Times in 36 Posts
Default

Hello there,

I've been trying the cheap facial mocap. One thing is for certain, your head needs to be stable otherwise you will have a lot of curve fixing in the graph editor.

However, I have one problem. All facial mocap locators move on the right hand side. But after parenting constraining, some of the bones still don't follow the facial locators movement.

Example: While the jaw moves up and down following the data from my facial mocap, the eye brows, upper lids and lower lids don't move at all. So, some move, some don't, leaving me wondering what is wrong.

Any ideas? Thank you




Last edited by cgisoul : 28-04-2012 at 04:35 AM.
cgisoul is offline   Reply With Quote
Old 28-04-2012, 04:50 AM   #5
PixalZA
Lifetime Member
 
PixalZA's Avatar
 
Join Date: May 2011
Location: Riyadh, Saudi Arabia
Posts: 525
Thanks: 67
Thanked 90 Times in 77 Posts
Default

Quote:
If you had a ps3, it's possible.
ND, you have my attention. I have a PS3 just sitting there gathering dust most of the time. How?
PixalZA is offline   Reply With Quote
Old 28-04-2012, 01:59 PM   #6
cgisoul
Lifetime Member
 
cgisoul's Avatar
 
Join Date: Apr 2011
Posts: 258
Thanks: 22
Thanked 37 Times in 36 Posts
Default

Fixed the problem! It works!!!!!!!!!!!!!
I now need to fix the sharp movements in the graph editor.
I'm going to make a new version next week with better skin weight painting.
This was a proof of concept and it works!

I can finally have a good night sleep.

Facial Motion Capture - Test1 - YouTube

Last edited by cgisoul : 28-04-2012 at 02:05 PM.
cgisoul is offline   Reply With Quote
Old 28-04-2012, 02:56 PM   #7
NextDesign
Technical Director
 
NextDesign's Avatar
 
Join Date: Feb 2004
Posts: 2,988
Thanks: 33
Thanked 532 Times in 471 Posts
Default

Quote:
Originally Posted by PixalZA View Post
ND, you have my attention. I have a PS3 just sitting there gathering dust most of the time. How?
With older versions of the PS3, you could install linux onto it. Sony disabled it with later versions of the firmware however.

@cgisoul: Looks cool, and with a little data cleaning to reduce the noise, it would be pretty useful as a base animation. Did you use frapper for this?
__________________
Imagination is more important than knowledge.
NextDesign is offline   Reply With Quote
Old 29-04-2012, 09:26 AM   #8
PixalZA
Lifetime Member
 
PixalZA's Avatar
 
Join Date: May 2011
Location: Riyadh, Saudi Arabia
Posts: 525
Thanks: 67
Thanked 90 Times in 77 Posts
Default

Thanks. Pity Sony is now blocking it. Would have been a good interrim solution until I upgrade my current machine.

Edit: @cgisoul, appologies for hijacking the thread

Last edited by PixalZA : 29-04-2012 at 09:33 AM.
PixalZA is offline   Reply With Quote
Old 03-05-2012, 11:29 AM   #9
cgisoul
Lifetime Member
 
cgisoul's Avatar
 
Join Date: Apr 2011
Posts: 258
Thanks: 22
Thanked 37 Times in 36 Posts
Default

Some updates on my research.

As the video shows, on the left hand side, I was holding my mobile Samsung GS2 both hands with my elbow on the table while capturing the facial expressions. The jittering was quite visible and very shaky.

However, on the right hand side, I made my own facial mocap "Fork" as you can see in the photo. It's basically 3 pieces of wood, attached together with some metal plate and that's it. The camera goes between as well as my head. Pretty simple and the results were stunning in comparison without using the DIY fork.

I hope this helps and explains how important Stability is needed while doing facial motion capture.

Next? Building my real helmet. The metal guy in the shop can build me the gig for $40 bucks!
I just have to come up with the helmet.

Facial Motion Capture - Jittering Comparison - YouTube
cgisoul is offline   Reply With Quote
New Thread

« Previous Thread | Next Thread »

Thread Tools

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off

Similar Threads
Thread Thread Starter Forum Replies Last Post
XBox Kinect For Mocap Acid44 Members Lounge 7 28-06-2011 07:15 AM

1 Month

$34

Month-to-month billing
$34/month
Unlimited access to all videos
Project files to download
Easy to cancel at anytime
 
 

3 months

$87

Billing every 3 months
$29/month
Unlimited access to all videos
Project files to download
Easy to cancel at anytime
Save $5 per month or $15 in total compared to monthly billing with this package.

12 months

$288

Billing every 12 months
$24/month
Unlimited access to all videos
Project files to download
Easy to cancel at anytime
Save $10 per month or $120 in total compared to monthly billing with this package.

Your plan will automatically renew. You can cancel at any time via your PayPal account to avoid being charged again.

You can view the FAQ on our video plans here. You can contact us directly here. By clicking one of the buttons above, you agree to our Terms and Privacy Policy.