Color passthrough with a webcam in Reverb G2

[jk9]

Maybe I am late to a party and everybody already knows this but yeah I just found out that it is possible.

Several months ago, I tried this SteamVR program called "Reality Mixer". It is a paid program which allows you to make "windows" in your virtual world and lets you to see the real world through the windows using the cameras on your headset.

It was a neat idea as I was struggling to interact with MFD, ICP, or even a keyboard while I am wearing a headset.

Sad thing is that my Reveb G2 has only low-res, black and white cameras. I could see the buttons but it was impossible to see detailed images due to the poor cameras.

Also, it only works under SteamVR. At that time, it was impossible to run stand alone version of MT executable under SteamVR.

It means a huge FPS lost. I could only do ST executable + no OpenXR tool kits + no DFR with my G2 Omnicept.

I loved the idea but it was not working for me. So I moved on.

Now, yesterday, I noticed that the developer of the program added an option to use an external USB camera instead of a built in VR headset camera. 

I gave it a try and wow. It works very well.

I just taped a $10 ali express webcam on my headset and it just works surprisingly well.

As you can see in the screenshots, the images are in color and the texts are quite readable. I could use a higher resolution camera but this webcam works for the time being.

But it only works in SteamVR, ST, no OpenXR tool kit. Isn't this a FPS killer?

Well, no. I guess ED have updated DCS MT to work in SteamVR in recent patches. I didn't know but I just works. No --force_steam_VR something something parameters, it just works.

All I had to do is to set "Current OpenXR Runtime" to "SteamVR" instead of "Windows Mixed Reality".

So MT is working. OpenXR tool kit is working(you can see "FPS:90.0" in the screenshots!). DFR is working. Color passthrough is working.

I am just amazed that all the things I hoped for a long time just suddenly work. Crazy.

I've ordered a smaller, higher resolution camera that can be mounted on my G2. I can't wait to see how it will work.

 

Edited August 3, 2024 by jk9

[firefox121]

Wow, I found the program too, but can,t use with reverb passthrough black and white. Will try this today.

Thanks for the advice

 

[The_Nephilim]

Yes I tried this too and sadly does not work well in MP. I had high hopes for this program but it did not work well in MP.

 

I found out that with a Quest 3 this is possible with using Virtual desktop and no lag..