An option to replace the VR hand models to enable passthrough

[MoleUK]

With Virtual Desktops new passthrough options, we can already use something like openkneeboard to create passthrough boxes as seen here:

However, VD also currently lets VR users emulate hand tracking to a limited degree as seen here:

If there were an option to replace the VR hand models with a flat coloured box of some sort (ideally resizeable and changeable colours) it would be fairly trivial to combine these two methods to create passthrough boxes that would follow your hands around in VR. At which point any of the simpit users could use it to better navigate their hardware/button boxes etc.

And since there is already an in-game option to show/hide the VR hands, it could be toggled at will.

[MoleUK]

Incase it's unclear, in the first video I am just displaying an MSPaint window in Openkneeboard painted bright red, then telling VD to key in for that colour and it uses the headset cameras to project RL footage over that colour.

You can key in pretty much any colour you want to use as the target. Even changing the hands to different colours would work a little, but ideally you would want a larger space to have the camera images projected on. So changing them to a simple rectangle, square or circle that you could resize and choose the colour of would be ideal.

Edited October 11, 2023 by MoleUK

[MoleUK]

Very rough visual idea of what i'm talking about. Because the DCS VR hand models have a fairly generic colour it's very hard to aim for it for targeted passthrough. A simple colour change to something vibrant would do wonders

 

[Maverick87Shaka]

If the quest3 becomes really popular, and it looks like, I think ED should be start to integrate a native way for MR, that is way far better than VR experience.
I Didn't have the quest3 yet, but tested the mixed reality with Varjo XR-3 and it was really insane.
Can't wait to have native support for it, and maybe a adeguate Mixed Reality headset as well

 

Edited October 11, 2023 by Maverick87Shaka

[MoleUK]

v2 proof of concept.

Need to reshape the hands into spheres now to really make this viable: