• Metaverse

  • Starting the Journey into the Metaverse with Face Capture & VR!

We want to get a jump on the metaverse. No, not the crappy Facebook version:

We want to go into the world of UnrealEngine and living in photo-realistic metaverse. Kinda like Xanadu:

Frankly, he is the reason we're diving in so deep.

Here's where our research has started so far:

https://www.rokoko.com/ - SmartSuit Pro II - A full package for $4000 or so. This is for mass appeal... however, there are products that are more pro, like:

https://www.xsens.com/motion-capture - MVN - Body suit (you have to email them for price, but it looks like the full setup is around $10,000) and you'll want to get the gloves as well:

https://www.manus-meta.com/xsens-gloves - Xsense Gloves from Manus. The gloves are $4000.

Obviously we'll be importing our video right into Unreal Engine and they have lots of libraries and objects and help that we can use to get started: https://www.unrealengine.com/
Really cool METAHUMAN to import life-like faces - https://www.unrealengine.com/en-US/metahuman-creator?sessionInvalidated=true

From here all we needed was a helmet, which now there are options to buy for under $700: https://neuronmocap.com/content/product/perception-neuron-face-mocap-helmet

We've found a couple of nice resources that help out DIY motion-capture people like: https://mocappys.com/

It seems like the price to get into the FULL motion capture world at Xanadu's level will be around $6000 if you're choosing the Rokoko setup. The Xsens setup fully in will be around $12-14,000.

We will update on what route we take and big shoutout and thanks to Xanadu with the video that convinced me I need to do this:

peter stickied the discussion.

I just finished watching this and... man.

I now know how to import my very own images into Unreal Engine so we can manipulate them and use them.

1 - Take a shit ton of photos of subject. In the video he took like 1700.
2 - Import into Lightroom - batch edit for low shadows, high detail. Export to JPEG.
3 - Import into RealityCapture - Go through tutorial. It's pretty long. 45 min or so.
4 - Export file then import into Unreal!

What amazed me the most is that this is literally a full tutorial on how to get any image into Unreal. Super powerful for the future.

What is also really cool about this journey is that... well, we're just documenting all our learnings. Amazing.
I absolutely cannot wait to import my first object into the metaverse and then 'play' with it!

    I clearly need to start at the beginning with basic tutorials, but I get so captivated by pro-level metaverse stuff.

    THIS is what I was looking for in terms of importing an entire room... and then being able to walk around inside of it.
    The cool part will be when you place objects you can interact with... now that!

    If you let your imagination go wild... you can have a friend work with you and video you in the metaverse while you're in avatar...

    Putting here for later. Started and will finish later.

    xSens finally got back to me and the prices of the body suit and all that are expensive!

    Looks like if you want to goes the xSens route you'll be looking at $20000.
    Maybe Rokoko is the entry level answer...

    2 months later

    peter

    very cool. This video makes me think of reaching out to these guys and see if they’d like to engage… I could give them an amazing canvas.

      It looks like they could do a sitetour. Would be cool to see what possibilities they have for a large space to build out a metaverse...

      5 days later

      Downloading metahumans on unreal5.
      Going into unreal5 as a noob is boring. You really need these templates... I can't wait to make a photorealistc version of.. myself?