2023年3月20日 · 从 Unreal 4.26 开始，手部跟踪基于 Unreal HeadMountedDisplay 插件，并在所有 XR 平台和设备上使用公共 API。 Windows Mixed Reality 和 OpenXR 系统的功能相同。 使用手势，你可以跟踪和使用用户的手和手指作为输入，可在蓝图和 C++ 中访问这些数据。 Unreal API 以坐标系统的形式发送数据，时钟周期与 Unreal Engine 同步。 该层次结构由 EHandKeypoint 枚举描述： 你可以使用“获取运动控制器数据”函数从用户手中获得所有这些数据。 该函数返回 …

Unreal Engine Royalty Payment Program. Add user input and interactions. Enable controllers. Overview. Getting Started. ... Touch Plus Controllers. Controllers Best Practices. Controllers Troubleshooting. Enable Hand Tracking. Set Up Hand Tracking. Use Capsense. Interactions. Overview. Getting Started. Architecture. Overview. Interaction ...

2022年10月23日 · Learn how to use hand tracking input, pose, hand meshes, and live link animations in Unreal mixed reality apps.

Learn how to use hand tracking input, pose, hand meshes, and live link animations in Unreal mixed reality apps. The hand tracking system uses a person’s palms and fingers as input. Data on position and rotation of every finger, the entire palm, and hand gestures is available.

This is a plugin that allows you to use hand tracking using the OpenXR plugin and the Hand Tracking extension. This plugin was tested on Meta Quest 3, but must work on any other device that supports the Hand Tracking extension.

Launch the project in the Unreal Editor using one of the following options. The easiest way to get started is to use the prebuilt Unreal Engine from the Epic Games Launcher, with MetaXR plugin. In the launcher, install UE5 (recommended). Download and install the MetaXR plugin from the Unreal Engine 5 Integration download page.

Use XRMotionControllerData to draw the debug lines/spheres and form hands. Please enable “XRVisualization” plugin in Edit > Plugins > Mixed Reality. Create a Blueprint and choose Actor as the parent class: In the Event Graph, we will call “Get Motion Controller Data” to get the hand tracking detection result.

Make sure the OpenXR Hand Tracking is enabled inside Edit > Plugins > Built-in > Virtual Reality > OpenXRHandTracking. The sample map is under Content > HandTracking > Map. Two maps are provided: HandTrackingMap and IK_HandTrackingMap. IK_HandTrackingMap demonstrates hand tracking with Inverse Kinematics.

2024年12月3日 · In this tutorial, we learn how to get the OpenXR Hand-Tracking Data from the Unreal Engine API and how to consume it to draw virtual hand models using cubes (as hand joints). We also dive into gesture recognition by implementing a simple pinch gesture detection.