Rokoko - Detailed Review
Entertainment
Rokoko - Product Overview
Rokoko Overview
Rokoko is a company that specializes in motion capture and character animation tools, making professional-grade animation accessible to a wide range of creators. Here’s a brief overview of what they offer:
Primary Function
Rokoko’s primary function is to provide motion capture solutions that allow users to record, visualize, and export full-body animations. Their tools enable the capture of body, finger, and face movements, which can be integrated into various 3D software platforms such as Unreal Engine, Unity, Blender, Maya, and more.
Target Audience
Rokoko’s products cater to a diverse audience, including indie creators, game developers, animation and VFX professionals, and educational institutions. With over 50,000 users worldwide, their tools are used by both small-scale creators and large studios.
Key Features
Motion Capture Tools
Rokoko offers several key tools, including the Smartsuit Pro II for body capture, Smartgloves for finger tracking, and the Face Capture app for facial expressions. These tools can be combined for full-performance capture.
Rokoko Studio Software
This software allows users to view, record, and export motion capture data. It includes features like real-time streaming to popular 3D software, retargeting, custom character import, and pose correction tools. Users can also apply filters to enhance animation quality, such as root locking and knee pop smoothing.
Rokoko Vision
This is an AI-based motion capture solution that uses camera technology to capture movements directly in the browser, making it accessible for users without specialized hardware.
Integration and Export Options
Rokoko Studio supports exporting animations in formats like .FBX and .BVH, with industry-compatible skeleton presets and custom export options.
Support and Plans
Rokoko offers various plans, including a free Starter plan, a Plus plan with live streaming and advanced features, a Pro plan with additional tools like face capture and offline use, and an Enterprise plan for custom solutions.
Overall, Rokoko’s products are designed to make motion capture and character animation more accessible, intuitive, and efficient for a broad range of creative professionals.
Rokoko - User Interface and Experience
User Interface Overview
The user interface of Rokoko’s AI-driven motion capture tools is designed with ease of use and user-friendly functionality in mind, making it accessible to a wide range of creators.Setup and Interface
Setting up Rokoko’s motion capture tools, such as the Smartsuit Pro II and Smartgloves, is remarkably simple. The process is guided by clear instructions on the official Rokoko YouTube channel, and the intuitive drag-and-drop interface makes connecting and calibrating the tools straightforward.Rokoko Video
For users of Rokoko Video, the free AI motion capture tool, the process begins in a web browser. Users can upload a video of a person moving or record themselves using a webcam or phone. After editing and trimming the clip, it is automatically uploaded to Rokoko’s AI-powered motion engine. This motion data can then be accessed in Rokoko Studio, where users can refine it using advanced filters like foot locking before exporting it to their preferred 3D software such as Blender, Cinema4D, Unity, or Unreal Engine.Rokoko Studio
Rokoko Studio serves as a central hub for all motion capture and animation needs. It allows users to capture, animate, live stream, edit, and export character animation projects. The software integrates seamlessly with various Rokoko tools, including the Smartsuit Pro II for body capture, Smartgloves for finger capture, and the Face Capture app for facial capture. Users can manipulate motion data through retargeting, custom character import, and pose correction tools, all within an intuitive interface.Ease of Use
The overall user experience is characterized by its ease of use. For example, Matt Estela, a Senior Houdini Artist, tested Rokoko’s Smartgloves and Coil Pro and found that the capture software was easy to use, with fast calibration and clean FBX exports. He noted that even complex motions, like those of a newsreader, could be captured and played back in just a few minutes without the need for extensive cleanup.Community Support
Rokoko also offers strong community support, which enhances the user experience. Resources such as the official Rokoko YouTube channel and the Discord group provide tutorials, discussions, and collaboration opportunities. This supportive community helps users refine their motion capture skills and stay updated with the latest developments.Export and Integration
The software allows for flexible export options, enabling users to transfer motion data to various 3D software platforms. This versatility ensures that users can work seamlessly across different applications, enhancing their creative possibilities. The export process is straightforward, with options to export in formats like .FBX or .BVH, and includes industry-compatible skeleton presets.Conclusion
In summary, Rokoko’s user interface is user-friendly, with a focus on simplicity and ease of use. The tools are designed to be accessible to both beginners and professionals, making motion capture and character animation more approachable and efficient. Rokoko - Key Features and Functionality
Rokoko Video
Video Upload and Recording
Rokoko Video allows users to upload a video of a person moving or record themselves using a webcam or phone camera. This video is then processed by Rokoko’s AI-powered motion engine to extract the motion data.AI-Powered Motion Extraction
The AI engine extracts full-body motion data from the video, which can be used to animate characters in games, films, and other applications. This process typically takes around 30-40 seconds to process 10 seconds of video.Integration with Rokoko Studio
The extracted motion data is accessible in Rokoko Studio, where users can edit, clean, and refine the animation. This includes using advanced filters such as foot locking to improve the quality of the motion capture.Rokoko Studio
Motion Data Editing and Cleaning
Rokoko Studio provides tools to clean and refine the motion capture data. Users can adjust foot locking, correct pose issues, and apply other filters to enhance the animation quality. This ensures that the final animation is more accurate and polished.Custom Character Import and Retargeting
Rokoko Studio allows users to import custom characters and retarget the motion data to these characters in real-time. This supports characters rigged on platforms like Mixamo, Unreal Mannequin, and others. The retargeting feature helps in adapting the motion data to characters of different proportions.Export Options
Users can export the motion capture data in formats like FBX and BVH, which are compatible with various 3D applications and game engines such as Blender, Maya, Unity, and Unreal Engine. This flexibility makes it easy to integrate the motion data into different workflows.Cloud Sharing and Collaboration
Rokoko Studio includes features for cloud sharing and project collaboration. Users can duplicate scenes, share them with team members, and work collaboratively without affecting the original scene. This enhances teamwork efficiency and project management.VR Chat Integration
Rokoko Studio offers integration with VR Chat, allowing users to use their Smartsuit Pro II in virtual reality environments. This includes live streaming and full-body calibration within VR Chat, making it easier to work in immersive environments.Real-Time Streaming
For users with Rokoko’s hardware tools like the Smartsuit Pro II and Smartgloves, Rokoko Studio can stream motion capture data in real-time to various 3D software and game engines. This real-time capability is crucial for applications requiring immediate feedback and live performance capture.AI Integration
Rokoko’s products heavily rely on AI to process and refine motion capture data. The AI engine in Rokoko Video automatically extracts motion data from video footage, while Rokoko Studio uses AI-driven algorithms to clean, retarget, and refine the motion capture data. This AI integration ensures that the motion capture process is efficient, accurate, and user-friendly. In summary, Rokoko’s tools provide a seamless and intuitive way to capture, edit, and use motion data for character animation, leveraging AI to streamline the process and improve accuracy. These features make it accessible for both beginners and professionals to create high-quality animations without the need for expensive hardware or extensive technical knowledge. Rokoko - Performance and Accuracy
When Evaluating Rokoko’s Motion Capture Products
When evaluating the performance and accuracy of Rokoko’s motion capture products, particularly in the entertainment and AI-driven categories, several key points stand out.
Motion Capture Accuracy
Rokoko’s Smartsuit Pro II and Smartgloves are highly regarded for their accuracy in capturing body and finger movements. The Smartsuit Pro II uses inertial measurement units (IMUs) to track the body’s motion in real-time, providing high-fidelity capture that is especially useful for complex motions. When combined with the Smartgloves, the system achieves advanced finger tracking, resulting in lifelike animations.
The addition of the Coil Pro, which uses electromagnetic fields (EMF) in conjunction with IMUs, significantly improves the accuracy of hand tracking by providing worldspace positions similar to optical systems but without the occlusion issues. This setup has been praised for its ability to capture precise hand movements, such as those of a newsreader or even more complex gestures like holding props or picking up a chair.
Limitations
Despite the high accuracy, there are some limitations to consider:
- Occlusion Issues: While the dual-camera setup in Rokoko Vision mitigates occlusion issues to some extent, single-camera setups can still suffer from reduced tracking capabilities when limbs are occluded. This is less of an issue with inertial mocap tools like the Smartsuit Pro II.
- Drift in IMU Systems: The Smartgloves, when used alone, can experience drift due to the limitations of IMU technology. This means that hands may intersect or slide away over time, especially in slow or constant velocity movements. However, pairing the gloves with the Smartsuit Pro II or using the Coil Pro can significantly reduce this drift.
- Multiple Performer Limitations: Currently, AI-based motion capture tools like Rokoko Vision are not capable of capturing more than one performer in the same recording. In contrast, inertial mocap tools from Rokoko can capture up to five performers simultaneously.
- Environmental Factors: The quality of the capture can be affected by background and lighting conditions, especially for video-based systems. Inertial tracking offers more flexibility in this regard, as it is less dependent on environmental factors.
Real-Time and Post-Processing
Rokoko’s inertial mocap tools, such as the Smartsuit Pro II, support real-time integrations with major 3D software, which is a significant advantage over AI-based motion capture that requires heavy post-processing to generate the animation file.
Software and Community Support
The Rokoko Studio software is user-friendly and offers intuitive filters to enhance the quality of the captured animations. It also supports seamless integration with various 3D software platforms like Houdini, Blender, and Cinema 4D. The community support, including resources like the official YouTube channel and Discord group, is highly valued for refining motion capture skills and staying updated with the latest developments.
Areas for Improvement
While Rokoko’s products are highly praised, there are areas where improvements can be made:
- Finger and Face Capture: While the Smartgloves excel in finger tracking, finger capture without additional support (like the Coil Pro) can be limited. Face capture is also available but may not be as detailed as finger tracking.
- Calibration and Setup: Although the setup is generally easy, certain environments (like those with strong magnetic interference) can affect the performance of the Smartsuit Pro II and Smartgloves. Continuous firmware updates are aimed at addressing these issues.
In summary, Rokoko’s motion capture products offer high accuracy and real-time capabilities, especially when combining different tools like the Smartsuit Pro II, Smartgloves, and Coil Pro. However, users should be aware of the potential limitations, particularly with occlusion and drift in certain setups, and the ongoing efforts to improve these aspects through software and firmware updates.
Rokoko - Pricing and Plans
Rokoko Pricing Plans
Rokoko offers a structured pricing plan for its motion capture and animation tools, catering to various needs and budgets. Here’s a breakdown of the different tiers and their features:
Starter Plan (Free)
- This plan is free forever and allows users to get familiar with Rokoko Studio.
- Features include:
- Viewing and recording motion capture data from the Smartsuit Pro II and Smartgloves.
- Rokoko Vision AI motion capture for recordings up to 15 seconds.
- Access to cleanup filters.
- Export options to .FBX format.
- Unlimited cloud asset storage.
Plus Plan
- This plan requires an annual commitment and costs $20 per month (billed annually).
- It includes all the features from the Starter plan, plus:
- Live streaming to software like Unreal Engine, Blender, Maya, etc.
- Rokoko Vision AI motion capture with unlimited recording length.
- Import and retarget custom characters.
- Advanced export options (.BVH, custom FPS, skeleton presets).
- Face Capture.
- Chat and email support with a 48-hour first response time (business days).
Pro Plan
- This plan also requires an annual commitment and costs $50 per month (billed annually).
- It includes all the features from the Plus plan, plus:
- Advanced command API.
- 21 days of offline use.
- UDP trigger messages.
- Export to .CSV format.
- A designated Customer Success Manager.
Enterprise Plan
- This plan has custom pricing and is designed for users with specific needs not covered by the other plans.
- It includes all the features from the Pro plan, plus custom services and a custom service level agreement.
Additional Features and Tools
- Rokoko Video: This is a free AI motion capture tool that allows users to record live or upload prerecorded videos to generate motion capture files. It is accessible via a browser and integrates with Rokoko Studio for further cleanup and export.
- Motion Library: Rokoko offers a Motion Library where users can access and purchase motion capture assets. The Basic plan includes full access to the Motion Library, allowing users to buy, share, and use these assets.
By choosing the appropriate plan, users can select the features that best fit their needs, whether they are just starting out or require more advanced capabilities.
Rokoko - Integration and Compatibility
Rokoko’s Motion Capture Tools and Software
Rokoko’s motion capture tools and software are designed to integrate seamlessly with a wide range of creative and technical platforms, making them highly compatible and versatile for various applications in the entertainment industry.
Integration with 3D Software and Game Engines
Rokoko Studio, the central software for Rokoko’s motion capture tools, integrates natively with popular 3D software and game engines. This includes Unreal Engine, Unity, Blender, Maya, Cinema 4D, Houdini, MotionBuilder, and iClone, among others.
- Users can stream motion capture data in real-time directly into their 3D scenes, allowing for immediate feedback and efficient workflow.
Compatibility with Rokoko Hardware
Rokoko’s ecosystem includes several hardware components that work together seamlessly:
- The Smartsuit Pro II for full-body motion capture can be used in conjunction with Smartgloves for finger and hand tracking, and the Face Capture solution for capturing facial expressions. All these tools can be operated in a synced and real-time environment through Rokoko Studio.
Sony Mocopi Integration
Rokoko has also partnered with Sony to integrate the mocopi body motion capture system. This allows users to set up the mocopi system with Rokoko Studio, enabling features like recording, live streaming, editing, and exporting motion capture data. The mocopi system can be complemented with Rokoko Smartgloves and Face Capture for a comprehensive performance capture setup.
Real-Time Streaming and Export Options
Rokoko Studio allows users to send motion capture data in real-time to their preferred 3D software. Additionally, users can export their animations in various formats such as .FBX or .BVH, with options for industry-compatible skeleton presets like Human IK and Mixamo.
Cross-Platform Compatibility
Rokoko’s tools are not limited to specific devices or operating systems. The Smartgloves, for example, can be paired with other motion capture tools from different brands, whether optical or sensor-based, thanks to Rokoko’s real-time integration plugins.
Live Streaming Plugins
Rokoko Studio provides live streaming plugins for various software platforms, enabling real-time applications and collaboration. This feature is particularly useful for game developers, animators, and other creatives who need immediate feedback and dynamic interaction with their characters.
Conclusion
In summary, Rokoko’s motion capture tools and software are highly integrated and compatible with a broad range of creative tools and platforms, making them a versatile and efficient choice for character animation workflows.
Rokoko - Customer Support and Resources
Customer Support Hours and Contact
Rokoko’s customer support team is available online weekdays between 09:00 AM and 05:00 PM (GMT 2), based in Greece. They also observe official Greek public holidays. Users can contact the support team through a specially prepared form on their website.
Support Plans and Response Times
Depending on the subscription plan, users have varying levels of support:
- Plus Plan: Includes chat and email support with a 48-hour first response time on business days.
- Pro Plan: In addition to the Plus plan’s support, users get a designated Customer Success Manager.
Knowledge Base and Guides
Rokoko provides an extensive knowledge base with various guides and tutorials. This includes articles on getting started with the Smartsuit Pro II, setting up the Smartsuit Pro II in Rokoko Studio, and troubleshooting common issues. The knowledge base covers topics such as Coil Pro, Headcam, Virtual Production, Face Capture, and more.
Tutorials and Workflows
Users can access a range of tutorials and how-to guides on Rokoko’s YouTube channel. These resources help users learn how to use the products effectively and explore different workflows and techniques.
Software Updates and Known Issues
Rokoko regularly updates their software, and users can find information on the latest build versions and known issues. For example, the Rokoko Studio 2.4.4 update includes improvements to Coil Pro and Face Capture, and there is a section dedicated to known issues and recommendations.
Community and Feedback
While the website does not explicitly mention a community forum, users can submit requests and feedback through the support form. This allows them to engage with the support team and provide suggestions for improving the products and services.
By providing these support options and resources, Rokoko aims to ensure that users can effectively use their products and resolve any issues that may arise.
Rokoko - Pros and Cons
Advantages
Accessibility and Ease of Use
Accessibility and Ease of Use: Rokoko offers a range of tools that make motion capture accessible to both professionals and hobbyists. The Smartsuit Pro II, Smartgloves, and Face Capture are user-friendly and do not require extensive technical knowledge or large studio spaces.
Real-Time Tracking
Real-Time Tracking: Rokoko’s tools provide real-time tracking capabilities, allowing animators to see their animations come to life immediately. This feature enhances the animation process by enabling quick iterations and improvements.
Comprehensive Solutions
Comprehensive Solutions: Rokoko provides a full suite of motion capture tools, including full-body, hand, and facial capture. This makes it a one-stop-shop for animators looking to create realistic and immersive animations.
Community Support
Community Support: Rokoko has a growing community of users, with resources such as tutorials, documentation, forums, and a Discord server. This community support is invaluable for learning and collaboration.
Flexibility and Versatility
Flexibility and Versatility: Tools like Rokoko Vision allow users to capture motion using just a webcam or by uploading video files. This flexibility makes it easy to experiment with motion capture without specialized hardware.
Creative Freedom
Creative Freedom: Motion capture with Rokoko allows actors to bring their own skills and personality to their roles, enhancing the performance and expression of characters. It also gives animators more flexibility to refine and enhance the captured data.
Disadvantages
Cost
Cost: While Rokoko offers some free tools like Rokoko Vision, the more advanced and high-fidelity tools such as the Smartsuit Pro II and Smartgloves can be expensive. This may be out of budget for some projects or individuals.
Data Quality and Occlusion
Data Quality and Occlusion: While Rokoko Vision is a great entry point, it may not provide the same level of data quality as inertial motion capture tools for more complex motions. Occlusion can also be an issue with video-based capture, where limbs outside the frame or in difficult positions can affect tracking accuracy.
Real-Time vs Post-Processed Data
Real-Time vs Post-Processed Data: AI-based motion capture tools like Rokoko Vision require post-processing, which can make real-time integration challenging. In contrast, inertial motion capture tools like the Smartsuit Pro II support real-time integrations with major 3D software.
Face and Finger Capture Limitations
Face and Finger Capture Limitations: While Rokoko offers advanced face capture, finger tracking still requires specialized tools like the Smartgloves. Video-based face capture solutions may not be as accurate as inertial capture methods.
Environmental Factors
Environmental Factors: Video-based capture can be affected by background, lighting, and distance to the camera, which may limit the tracking space. Inertial tracking, however, offers more flexibility in these regards.
Multi-Performer Limitations
Multi-Performer Limitations: Currently, AI-based motion capture tools like Rokoko Vision cannot capture more than one performer in the same recording, whereas inertial tools can handle up to five performers simultaneously.
By weighing these pros and cons, users can make informed decisions about which Rokoko tools best fit their specific needs and project requirements.
Rokoko - Comparison with Competitors
When Comparing Rokoko with Other Motion Capture Solutions
When comparing Rokoko with other motion capture solutions in the entertainment and animation industry, several key features and differences stand out.
Motion Capture Suits
Rokoko’s Smartsuit Pro II is a prominent inertial motion capture suit that offers full-body performance capture, integrated with finger and face capture capabilities. Here are some comparisons with similar products:
Rokoko Smartsuit Pro II
This suit is lightweight, wireless, and easy to use, making it suitable for indie game developers, animation studios, and film production teams. It provides real-time tracking and can be used in various environments, although it may face occasional tracking issues due to magnetic interference and Wi-Fi stability.
Xsens MVN Link
This is a high-end inertial motion capture suit known for its exceptional real-time tracking accuracy but is more expensive and requires careful handling. It has different tiers, with the top-tier offering the best performance but also the highest cost.
Perception Neuron
This is another inertial motion capture suit, but it lacks extensive user-generated content and reliability feedback compared to Rokoko and Xsens.
Video-Based Mocap Systems
Rokoko also offers AI-based video-to-animation solutions, which are an alternative to traditional suit-based systems:
Rokoko Vision
This AI-driven solution allows users to capture motion from video recordings using a single or dual camera setup. It offers high motion fidelity, real-time tracking, and is free for single-camera use, with a paid plan for dual-camera tracking. However, it lacks hand tracking and may have issues with head direction.
Move AI and AR51
These are other AI-based video-to-animation solutions. Move AI is suitable for outdoor use and tracks various body types but lacks hand and finger tracking and real-time feedback. AR51 offers real-time tracking but is more expensive and still faces challenges in hand tracking.
Unique Features of Rokoko
Comprehensive Capture
Rokoko stands out by offering a complete package that includes full-body (Smartsuit Pro II), hand (Smartgloves), and facial (Face Capture) motion capture, all of which can be integrated and used in real-time.
Real-Time Tracking
Rokoko’s tools, including the Smartsuit Pro II and Rokoko Vision, provide real-time tracking, allowing animators to see their performances come to life immediately and make adjustments on the fly.
User-Friendly Interface
Rokoko Studio software is designed to be user-friendly, allowing for easy recording, editing, and exporting of motion capture data to various 3D software platforms like Unreal Engine, Blender, and Maya.
Accessibility
Rokoko offers a free version of its Rokoko Video tool and a free plan for Rokoko Vision, making motion capture more accessible to hobbyists and professionals alike.
Potential Alternatives
OptiTrack and Vicon
These are high-end optical motion capture systems known for their high fidelity tracking quality but require a significant investment in a dedicated tracking space with multiple cameras. They are more suited for large-scale productions and those with the budget for such setups.
Cascadeur
This is a standalone 3D keyframe animation software that does not offer motion capture capabilities but can be used in conjunction with other motion capture tools for keyframe animation needs.
In summary, Rokoko’s suite of products offers a unique blend of comprehensive motion capture capabilities, real-time tracking, and user-friendly software, making it a versatile choice for both professionals and hobbyists in the animation and entertainment industry. However, the choice of motion capture solution ultimately depends on the specific needs and budget of the user.
Rokoko - Frequently Asked Questions
Frequently Asked Questions about Rokoko
What are the main products offered by Rokoko?
Rokoko offers a range of motion capture tools, including the Smartsuit Pro II, Smartgloves, Face Capture, and the free Rokoko Video tool. The Smartsuit Pro II is a full-body performance capture suit, Smartgloves capture hand and finger movements, and Face Capture records facial expressions. The Rokoko Video tool allows users to create animations using their webcam.How does the Smartsuit Pro II work?
The Smartsuit Pro II is a lightweight, wireless, and easy-to-use full-body performance capture suit. It allows animators to record high-quality motion capture data without the need for a dedicated studio. It is perfect for indie game developers, animation studios, and film production teams looking to streamline their animation workflows.What are the features of Rokoko’s Smartgloves?
Rokoko’s Smartgloves use proprietary EMF motion capture technology to capture the subtlest movements and gestures of the hands and fingers. They can be used in conjunction with the Smartsuit Pro II or as a standalone solution for hand and finger motion capture. This technology eliminates drift and provides real-time global positioning without the need for cameras or markers.How does the Face Capture tool work?
The Face Capture tool from Rokoko allows animators to create realistic facial animations by capturing an actor’s facial expressions and transferring them to a digital character. This can be used as a standalone tool or in combination with the Smartsuit Pro II and Smartgloves for full performance capture.What is Rokoko Video and how does it work?
Rokoko Video is a free tool that enables users to create animations using their webcam. This user-friendly solution allows animators to bring their ideas to life in minutes without any specialized hardware or software. It is ideal for those new to motion capture or looking for a quick and easy way to experiment with animation.Can Rokoko tools be integrated with other software?
Yes, Rokoko’s motion capture tools can be integrated with various 3D software such as Unreal Engine, Unity, Blender, Maya, and Cinema 4D. The Rokoko Studio software allows users to send motion capture data in real-time to these platforms, making it easy to incorporate into existing workflows.What are the real-time tracking capabilities of Rokoko’s tools?
Rokoko’s tools offer real-time tracking capabilities, allowing users to see their animations come to life immediately as they perform. This feature provides immediate feedback, enabling animators to iterate and perfect their performances more efficiently. It also opens up possibilities for virtual production, live performances, and interactive experiences.How does Rokoko Vision work?
Rokoko Vision is an AI-powered motion capture solution that allows users to record live video or upload recorded files and convert them into animations. It operates within a browser app and is free to use, although additional features like multi-camera support require a subscription. The tool includes features like foot lock and can be used in conjunction with Rokoko Studio for editing and exporting animations.What kind of support and resources does Rokoko offer?
Rokoko provides various resources such as tutorials, documentation, and forums on their website. These resources help users learn and improve their skills with the motion capture tools. Additionally, Rokoko Studio software offers editing options and export formats, making it a comprehensive tool for character animation needs.Are there any pricing plans for Rokoko’s software ecosystem?
Yes, Rokoko offers different pricing plans, including a free plan with core features. The plans vary in features such as real-time retargeting, elevation tracking, and the number of simultaneous mocap actors. Users can choose a plan that best fits their needs, from basic to enterprise levels.Can I use Rokoko tools offline?
Rokoko’s tools do allow for some offline use, but there are limitations. For example, the amount of time you can remain disconnected from an internet connection before needing to reconnect varies depending on the plan you are on.