Hand Tracking

Hand tracking lets you reach into the virtual world with your hands and without using a physical controller. Gestures such as pinching, grabbing, and interacting with objects allow for a new level of immersion in your applications.

Varjo has two hand tracking modes to choose from.The mode can be changed from Varjo Base.

See the platform-specific documentation for hand tracking:

• Native hand tracking (Ultraleap only)
• OpenXR hand tracking
• Unity hand tracking (Ultraleap recommended)
• Unreal hand tracking

Varjo hand tracking

Varjo hand tracking uses the headset’s video pass-through cameras.

Varjo hand tracking does not require any additional installations or SDKs when using or developing as the feature uses standard OpenXR hand tracking. Varjo native SDK is not available.

Ultraleap hand tracking

Note: Ultraleap Gemini software should not be installed.

Varjo XR-4 supports for Ultraleap hand tracking. This requires an external Ultraleap hand tracking module installed on the headset and connected to the PC.

If you have previously used standalone Ultraleap sensor, please uninstall its drivers as Varjo Base comes with necessary drivers for the sensors. Having multiple drivers installed is not supported.

Refer to Ultraleap’s documentation for up-to-date guides on integration.

We also recommend that you get acquainted with Ultraleap’s XR design guidelines before you start to work on hand tracking interactions. The guidelines provide valuable information for using hand tracking successfully in your project.