Mocap Fusion

Game has been added to your Wishlist

Mocap Fusion [VR]

Step into the world of Mocap Fusion, a groundbreaking motion capture sandbox designed for artists and animators eager to craft and export lifelike animations using standard VR equipment. Whether you're aiming to produce captivating live content or create animations for your unique avatars, this immersive roomscale experience allows you to do it all with just a VR headset and two controllers. Advanced users can delve deeper, utilizing full-body tracking and integrating additional sensors such as the Apple iPhone Truedepth sensor and Oculus Quest 2 optical finger tracking to bring their avatars to life with simultaneous inputs. This innovative blend of sensors enables users to layer motion capture data in a single recording, covering aspects like full-body movement, facial capture, lip sync, gaze tracking, and finger articulation.

Key Features

• Create motion capture with personalized avatars, scenes, and props.
• Incorporate custom shaders, textures, emotes, and dynamic physics for a unique touch.
• Support for Vive Pro Eye, Vive lip tracking, and iPhone ARKit face capture.
• Compatible with HTC Vive, Valve Index, Oculus Rift, Oculus Quest 2, and select WMR headsets.
• Utilize without VR, with trackers only, or with just iPhone head tracking.
• Include multiple avatars in your scenes, craft storyboards, and interact with pre-recorded avatars.
• Capture camera motion and zoom, placing the player in the role of cinematographer within the VR space.
• Experience VTOL and Fixed Wing flight simulation for stunning aerial shots.

Output Formats Supported

• Export to SFM (.dmx).
• Export to Blender (.blend).
• Export to Unity (.anim).

Live-Link Plugins for Real-Time Production

• Live Link plugin for Unreal Engine (live avatar synchronization, recording).
• Live Link plugin for Blender (live avatar synchronization, recording).
• Live Link plugin for Unity (live avatar synchronization).

With the ability to use custom avatars throughout the production process, Mocap Fusion eliminates the need for retargeting, ensuring that your motion capture data aligns perfectly without any discrepancies in the final output.

One standout feature of Mocap Fusion is its capability to export motion capture data and reconstruct scenes in Blender, allowing for quick final rendering in just minutes.

Supported VR Headsets

• Valve Index
• HTC Vive (including Vive Pro Eye)
• Oculus Quest (1 and 2)

Optional Tracking Hardware

• SteamVR Vive trackers.
• iPhone Truedepth sensor (for face capture and eye tracking).
• Oculus Quest 2 (for full optical finger tracking).

Features and Capabilities

• Instantly export mocap data and create scenes in Blender™.
• Full body tracking with HTC™ Vive Trackers (up to 11 optional points).
• Record, playback, pause, and scrub through mocap in VR.
• Customizable IK profiles and avatar parameters for personalized experiences.
• Support for SteamVR Knuckles for individual finger movements.
• Quest 2 optical finger tracking for enhanced finger articulation.
• Vive Pro Eye support for blink and gaze tracking.
• Sidekick IOS app for markerless AR facial tracking.
• Create unique worlds, avatars, and props using the APS_SDK.
• Compatible with existing Unity3D™ avatars and environments.
• Support for custom shaders on mocap avatars.
• DynamicBone support for realistic hair, clothing, and body physics.
• Breathing simulation for lifelike chest movement.
• Recordable VR cameras for realistic camera motion capture.
• Optimize mocap (.bvh) data exports for Daz 3D.
• Set up streaming cameras for live avatar broadcasts.
• Microphone audio recording integrated with lip-sync visemes.
• Storyboard mode to save and replay mocap experiences.
• Animatic video player to display stories and choreograph movements.
• Dual-handed weapon IK solvers for realistic handling of firearms.
• Recordable VTOL platforms for animating flight simulations.
• Link VR cameras and props to trackers for immersive experiences.
• Ghost curves to visualize future avatar positions in scenes.

Gameplay Experience

Your experience with Mocap Fusion will vary based on your PC and tracking hardware. For optimal results, we recommend using the SteamVR headsets, particularly the Valve Index or HTC Vive. The Quest HMD can also deliver satisfactory performance. Notably, the software can function without an HMD, making it suitable for livestreaming. Full body tracking requires the use of foot and hip trackers, with optional elbow, knee, and chest trackers enhancing realism. Users can achieve even more lifelike tracking by enabling face capture or utilizing the Vive Pro Eye for gaze and blink tracking.

Project Background

This innovative tool was initially developed to provide users with an intuitive platform for creating virtual training videos and presentations in a realistic VR setting. Following its beta testing phase, Mocap Fusion has evolved significantly, incorporating valuable feedback and feature requests from the community to enhance its utility for a diverse range of creators.