Passthrough full cockpit view

[mrwell]

Hi mates,

I've been in VR from the very beginning and I'm a cockpit builder. My dream always was to be able to see my cockpit through my stereo front cameras and all the rest coming from DCS.

 

Well, there were some dirty solutions so far, but very limited or very expensive. We finally have the first affordable, easy and powerful solution.

 

With Virtual Desktop new feature (still beta), we could define which part of a cockpit can be seen through Quest 3 passthrough, while in DCS.

 

All we need is to create a DCS cockpit model in a flat chosen color (pink?) but avoiding to mask the parts you want to see from DCS. In my case with the Viper, only MFDs, HUD and the upper part (towel racks, canopy seals and canopy) won't be masked. All the rest would be pink.

 

This way, we will see our real life well illuminated cockpit through the passthrough cameras, and the rest through DCS, isn't it great?

 

Here a concept video, not mine, of the idea:

 

 

Now, who knows how to edit a 3D model cockpit to achieve this? ;)

 

Take care,

Mr.Well

[TED]

Did anyone get this working in dcs in any way? 

[venec]

On 12/21/2023 at 10:32 AM, TED said:

Did anyone get this working in dcs in any way? 

I got it Working somewhat on the F18. I changed some of the cockpit textures to pink, and using the quest and virtual Desktop I got it to show the transparency where you see pink in the screenshot attached. The textures are still there so there's some glare and change of color with lighting, someone with more mod experience could probably replace the whole panel with a flat surface painted pink?

I can post the files if you want to try it.

[TED]

5 hours ago, venec said:

I got it Working somewhat on the F18. I changed some of the cockpit textures to pink, and using the quest and virtual Desktop I got it to show the transparency where you see pink in the screenshot attached. The textures are still there so there's some glare and change of color with lighting, someone with more mod experience could probably replace the whole panel with a flat surface painted pink?

I can post the files if you want to try it.

Great work! That's exactly what I was thinking, although I thought it wasn't possible to actually edit or change the official modules because they were encrypted! How did u actually manage this?

Please do share the files. I'd be very interested to give this a go and perhaps play with it and tweak it if I can. DM me if you prefer. 

[Phantom711]

@venec

Would be great, if you could share the files. This pretty much exactly mimics the Winwing MIP….

Passthrough in the Quest Pro isn‘t all that great, but I would like to try if/how it works in principle.

[mrwell]

Hi,
I think the same. Sharing would be great.
I tried with my limited knowledge and I couldn't get much.
Anyhow, a game developer told me that DCS should implement that, because glaring, shadows, etc. need to show the same behavior. If not, weird things would happen when the sun or the shadow hits the panels.

Falcon BMS is getting ready to release it...

Cheers,
Mr.Well

[ForeverInsomniac]

I am looking to find a away to make  mask of inside if cockpit so when I finish 1:1 pit I can see everything outside and touch everything in reality

[NaK]

the simplest and best way (IMHO) is to replace the nomex glove models for the VR hands that DCS has with pink spheres, slightly larger than your hands, to encompass them, and make them not be affected by global illumination.

This would result in you seeing the real world in passthrough wherever your  hands are moving to. I have a full simput with working MFCD screens, but in VR i'd rather look at the actual in-game simulated screens. However, seeing which button in your pit your hand is about to hit and switch to actuate is infinitely better than fumbling your way there by touch.

If ED or anyone could give us "VR Passthrough hands" as an in-game option and they have some distinct chroma key color, it would be a godsend.

[Kirk66]

Bumping this as I would also like to try this. Using a Quest Pro, I just want to see my button boxes/panels so I can select switches easier, but since I fly multiple aircraft, do not want a full panel mask - and ideally one could toggle the pass-through on and off as needed, so I could still use a mouse on virtual controls that are not mapped to physical controls. 

Any ideas?

[sleighzy]

On 5/29/2024 at 2:20 AM, NaK said:

the simplest and best way (IMHO) is to replace the nomex glove models for the VR hands that DCS has with pink spheres, slightly larger than your hands, to encompass them, and make them not be affected by global illumination.

This would result in you seeing the real world in passthrough wherever your  hands are moving to. I have a full simput with working MFCD screens, but in VR i'd rather look at the actual in-game simulated screens. However, seeing which button in your pit your hand is about to hit and switch to actuate is infinitely better than fumbling your way there by touch.

If ED or anyone could give us "VR Passthrough hands" as an in-game option and they have some distinct chroma key color, it would be a godsend.

Virtual Desktop has native support for hands pass through without needing chroma key for them now. 

On 10/26/2024 at 7:15 AM, Kirk66 said:

Bumping this as I would also like to try this. Using a Quest Pro, I just want to see my button boxes/panels so I can select switches easier, but since I fly multiple aircraft, do not want a full panel mask - and ideally one could toggle the pass-through on and off as needed, so I could still use a mouse on virtual controls that are not mapped to physical controls. 

Any ideas?

The best implementations I have seen have been people using VirtualDesktop with OpenKneeboard. This can be used as an overlay, with the kneeboard pages containing the coloured section you want for pass through. This could also potentially work for different aircraft as you could have a kneeboard page per plane. 

Edited October 26, 2024 by sleighzy

[Yuriks]

Works great in Q3+MSFS, this guy changed cockpit material to pink 

 

@BIGNEWY, ED team, would be great to have this option. Quality passthrough is coming to budget VR headsets and it is a next level experience.   

Edited October 27, 2024 by Yuriks

[BIGNEWY]

Hi, I can mention it to the team, but can not promise anything.

thank you 

[Rapti]

Hi, I can mention it to the team, but can not promise anything.
thank you 

This would be sooooo great!

Gesendet von meinem SM-S928B mit Tapatalk

[Gun Jam]

sominum vr1

[Yuriks]

On 10/27/2024 at 3:20 PM, BIGNEWY said:

Hi, I can mention it to the team, but can not promise anything.

thank you 

Thank you @BIGNEWY

[Tzigy]

Somnium

Works amazingly well. I was ther.