this post was submitted on 29 Mar 2024
12 points (100.0% liked)

Virtual Reality

2009 readers
4 users here now

Virtual Reality - Quest, PCVR, PSVR2, Pico, Mixed Reality, ect. Open discussion of all VR platforms, games, and apps.

founded 2 years ago
MODERATORS
 

Using a screen capture from the [Vision Pro] which views both the passthrough hand and the virtual hand, we can see how many frames it takes between when the passthrough hand moves and when the virtual hand moves. […] we found this to be about 3.5 frames. At the capture rate of 30 FPS, that’s 116.7ms. Then we add to that Vision Pro’s known passthrough latency of about 11ms, for the final result of 127.7ms of photon to hand-tracking latency. […] Using a similar test, we found Quest 3’s hand-tracking latency to be around 70ms on Quest OS v63.

An important point here: latency and accuracy of hand-tracking are two different things. In many cases, they may even have an inverse relationship. If you optimize your hand-tracking algorithm for speed, you may give up some accuracy. And if you optimize it for accuracy, you may give up some speed. As of now we don’t have a good measure of hand-tracking accuracy for either headset, outside of a gut feeling.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 2 points 9 months ago (1 children)

that's really high latency for Apple, definitely not made for gaming

of course I wish the Quest 3 had more accurate hand tracking, but I usually use the controllers anyways

[–] [email protected] 2 points 9 months ago* (last edited 9 months ago)

Using hand tracking vs controller for gaming is a night and day difference. But that the Quest is actually faster is not what I would’ve guessed. The interesting bit is that the camera itself has a higher latency:

Quest 3’s passthrough latency is about three-and-a-half times that of Vision Pro (11ms vs. 39ms)

The article makes the point that that makes the tracking feel even faster on Quest, because the image is slower.