PCVR

Overview

With standalone devices, all rendering and processing happens on the headset itself. With non-standalone devices, also referred to as PCVR, all rendering and most of the related processing happens on a computer connected to the headset either via a physical cable, or wirelessly.

For developers, working in a PCVR-based environment can be simpler and more productive than continuously deploying and testing on a standalone VR device. This is because development, testing, debugging, and profiling methods and tools are mostly the same as with regular desktop Windows or Linux applications, which the VR application still is, even though it may not render anything on-screen on the desktop.

For end-users, however, setting up and running with PCVR can be more convoluted than simply installing the application on a standalone device.

With devices where both approaches are possible (for example, the Meta Quest 3), it can be useful for productivity to combine the two. Use PCVR (or even the Meta XR Simulator) during development when it makes sense, but focus on the standalone (Android) build for AR features and for final delivery to end-users.

When it comes to input, data from the headset's controller is delivered to the application running on the PC via the OpenXR API, no differently than with applications running on the headset directly. In addition, the application may still rely on peripherals connected to the PC for further input methods, although this should be considered carefully since relying on keyboard or mouse input has a number of potential pitfalls.

Further considerations

With PCVR, the quality and performance depends heavily on the host PC's capabilities, but the streaming technology and associated factors, such as the wireless network bandwidth, can affect the results as well. This also means that the visual experience may vary between runs and between environments, especially if wireless streaming is used.

Some features may not be available or may be limited compared to standalone devices, especially AR-related ones. Consider passthrough, for example. In standalone mode, the application and the underlying software stack have easy access to the headset's camera feed. When streaming from a remote computer, passthrough may become expensive and could involve a lot of additional data transfer to the PC. Therefore it is not uncommon that AR and spatial-related features are not available in PCVR systems.

In the PCVR ecosystem, there are multiple solutions that provide an OpenXR implementation and wired or wireless streaming, with varying availability, depending on the device used. Some runtimes are tied to a specific streaming solution, and each of them may provide a different set of features.

Support for 3D APIs varies too. Generally, Direct 3D 11, Direct 3D 12, and Vulkan can be expected to be supported by all OpenXR implementations on Windows. OpenGL support is rare and has not been tested by Qt with PCVR.

Changing the 3D API used is no different from any Qt Quick or Qt Quick 3D application: set the environment variable QSG_RHI_BACKEND (for example, to d3d12) or call QQuickWindow::setGraphicsApi().

Choosing the OpenXR Implementation

With the standard Khronos OpenXR loader, there are multiple ways to change what implementation gets loaded:

• Set the environment variable XR_RUNTIME_JSON. For example, setting XR_RUNTIME_JSON=c:\MetaXRSimulator\meta_openxr_simulator.json makes the Qt Quick 3D Xr application launched afterwards to pick the Meta XR Simulator's OpenXR implementation.
• Alternatively, the setting can be made permanent via the registry. (on Windows) Check/change the value of ActiveRuntime under Computer\HKEY_LOCAL_MACHINE\SOFTWARE\Khronos\OpenXR\1
• Some streaming solutions may have options in their settings to force using a given OpenXR implementations.

Wireless streaming solutions for the Meta Quest 3

• Meta Quest Link and Air Link
• Steam Link VR is a solution similar to Air Link
• Virtual Desktop is a remote desktop tool with wireless streaming as well.

Tables of Tested Configurations

Meta Quest 3

• Wired connection (USB-C), Oculus OpenXR runtime
• Wired connection (USB-C), SteamVR OpenXR runtime
• Wireless connection via AirLink, Oculus OpenXR runtime
• Wireless connection via AirLink, SteamVR OpenXR runtime
• Wireless connection via SteamLink, SteamVR OpenXR runtime
• Wireless connection via Virtual Desktop, SteamVR OpenXR runtime
• Wireless connection via Virtual Desktop, VDXR OpenXR runtime

Special

• Meta XR Simulator (Windows only; macOS has not been tested by Qt for the time being)

Further reading

This page cannot possibly dive into all the details, configuration issues, and possibilities around PCVR. For a good summary and introduction on the topic of streaming and OpenXR implementations, it is recommended to take a look at the the VDXR wiki.