Hand Tracking UFC Suggestion

[SebLG_A10]

Hi, 

I fly exclusively in VR and love like many other here to switch aircraft. I dream for proper hand tracking which permit to precisely activate every switches and dials, and better HD mixed reality . 

I know the actual most advanced solution is leapmotion + Slugmouse but I would suggest an idea. Hand tracking with a tablet on a adjustable support as UFC.

An App with reproduction of each UFC aircrafts which communicate via WiFi protocol like OSC.

Firstly, you will adjust the support to perfectly match the ingame depth when touching the ufc .

Next app will ask to touch the 5 on ingame UFC to calibrate the position of the center of the tablet ufc

Next ask for touch or move a cross to calibrate top right and down left to scale in order to perfectly match ingame.

In add for immersion , tablet would provide haptic feedback on touch, I am not able to script this thing but I think it would be a great addition for VR users.

[Hempstead]

I have been building that for a while already, except I write my own USB firmware for them, with home build accurate panels (mostly 3D printing and laser engraving), instead of tablets. Actually, quite a few people have been doing the same thing.

For this scheme to work well. You need two things.

1. a way to see the real world and the VR world. For instance switch to camera view and back to VR 24 time a second, or build a transparent overlap with an OpenXR layer. Otherwise alignment is a bit tricky.

This is made even more challenging by DCS’s recent change to one shot recentering of the VR, instead of continuing recentering while you hold down the recenter button until you release the button.

2. You need a way to see your finger tip in order to do the feedback loop to navigating your finger tip, real or representation in VR, accurately. Quest’s hand tracking is not there. A few cm off, and refresh rate is too low, resolution is too crappy. 
 

 

[Qcumber]

5 hours ago, SebLG_A10 said:

Hi, 

I fly exclusively in VR and love like many other here to switch aircraft. I dream for proper hand tracking which permit to precisely activate every switches and dials, and better HD mixed reality . 

I know the actual most advanced solution is leapmotion + Slugmouse but I would suggest an idea. Hand tracking with a tablet on a adjustable support as UFC.

An App with reproduction of each UFC aircrafts which communicate via WiFi protocol like OSC.

Firstly, you will adjust the support to perfectly match the ingame depth when touching the ufc .

Next app will ask to touch the 5 on ingame UFC to calibrate the position of the center of the tablet ufc

Next ask for touch or move a cross to calibrate top right and down left to scale in order to perfectly match ingame.

In add for immersion , tablet would provide haptic feedback on touch, I am not able to script this thing but I think it would be a great addition for VR users.

I did something similar a while back with a graphics tablet and got some interesting use out of it. I just positioned the tablet relative to my cockpit view over the MFD or keypad. It worked to a degree. You can also use to track around as well. 

[flusim]

I use leap motion for hand tracking.

I have built a panel mockup out of plastic for various aircraft - with the dimensions of the DCS cockpits. 

I covered these with soft black foam. This gives me good tracking and feedback when I touch a button.