Using a tablet for touch control, with VR headset on. (demo vid)

[metalnwood]

Some others might want to try this as I am having good success after only a day mucking about and less than an hour in the seat trying it.

 

 

Unexpectedly I am hitting many buttons first time. Largely due to having the tablet close to me and its position in VR at the same point as it is in real space. Being close you still get a reasonable feeling of where your finger is.

 

 

The idea is not that you have to hit the button, you touch the pad and then see the pointer in the vr overlay, move your finger over button and you are there. I find you always get very close so it is not a time consuming thing.

 

 

Here is a quick demo in iracing, not flying of me randomly pressing buttons. I think only once I went direct for a button and didn;t hit it.

 

 

At the 1m08s mark you can see how you would normally do it for 100% reliability.

 

 

I figured if it works for racing it will work for flying.

 

 

Free program called 'scrcpy' to mirror android tablet and Matric for button box software. I was using ovr toolkit to overlay it.

 

 

 

Link To video here as embedding seems to have a problem

 

Edited June 16, 2020 by metalnwood

[Andrew u.k.]

That's cool, thanks for sharing.

I'm thinking of using a graphics pad as a knee board and have it positioned on my knee in VR. So what I write appears in the cockpit.

 

 

Sent from my SM-N960F using Tapatalk

[VirusAM]

Really nice idea.....

I wonder if this can be replicated with an ipad someway...

I hope the matric creator port it to iOS

[Lange_666]

Video is already dead...

[Andrew u.k.]

Video is already dead...

Bad link I think.

 

Sent from my SM-N960F using Tapatalk

[metalnwood]

Video is already dead...

 

 

I don't know why it seems to have died, its up on the tube but the embedding seems to have a problem.

[metalnwood]

Really nice idea.....

I wonder if this can be replicated with an ipad someway...

I hope the matric creator port it to iOS

 

 

I have moved from matric to touch portal after some playing about. Matric out of the box has some profiles already filled in but I found that it didnt have some features that I wanted.

 

 

Touch portal supports ios as well.

[VirusAM]

I have moved from matric to touch portal after some playing about. Matric out of the box has some profiles already filled in but I found that it didnt have some features that I wanted.

 

 

Touch portal supports ios as well.

 

 

 

Nice, thanks...

I will research and test this when i will have time

[Andrew u.k.]

I'm using oculus and tried to figure out how to get the overlay working in vr.

Am I right that it works with steam but not stand alone version and oculus mirror of dcs?

 

Sent from my SM-N960F using Tapatalk

[Ala12Rv-Tundra]

X-Plane guys do that

[Snake122]

That's cool, thanks for sharing.

I'm thinking of using a graphics pad as a knee board and have it positioned on my knee in VR. So what I write appears in the cockpit.

 

 

Sent from my SM-N960F using Tapatalk

It's been done, developer moved away from display tablets to drawing tablets (no screen) to get better writing support since you don't see the tablet screen in VR and if you don't have a tablet to dedicate to it already you can get one of these drawing pads for $40USD.

https://forums.eagle.ru/showthread.php?t=246970

[metalnwood]

I'm using oculus and tried to figure out how to get the overlay working in vr.

Am I right that it works with steam but not stand alone version and oculus mirror of dcs?

 

 

Sent from my SM-N960F using Tapatalk

 

 

I am using an index so steam vr. I think for oculus you bring it in with the oculus desktop and a feature to pin a window in to the VR space. I forget specifically how you do it though.

 

 

X-Plane guys do that

I got the idea initially from seeing an xplane video where a guy showed that he was using a streamdeck. The stream deck has the physical device that you interact with and a copy on the pc that shows the state of the streamdeck, i.e. the current button layout. I saw that they put that in the VR space but the difference is that you are a bit blind actually interacting with the streamdeck as the VR copy doesnt give you any feedback as to what button you are hovering over until you press it and hope you git it right. This shows you real time in VR where your finger is so you know what you are about to press.

 

 

 

 

 

 

 

It's been done, developer moved away from display tablets to drawing tablets (no screen) to get better writing support since you don't see the tablet screen in VR and if you don't have a tablet to dedicate to it already you can get one of these drawing pads for $40USD.

https://forums.eagle.ru/showthread.php?t=246970

 

(Doh!, I will leave what I wrote below but I see you were directly replying to Andrew specifically about the kneeboard!)

 

 

I haven't been in DCS for a bit I admit so I missed this but it does look like they are different things. With this giving you a configurable button box and the type of use looks different.

 

 

Having said that, I can see how I am using it as something that is quite suited to racing where we don't have the cockpits with every button working and even if we did it would not be easy to work manage them with a mouse while racing. So it may be that in VR, using a mouse on the cockpits is a better proposition than this.

 

 

 

I guess thats up to anyone looking if they might find any value in it, I am just showing an idea :)

 

 

Re using the touch tablet with screen, I am actually finding it useful outside of VR.. I have a screen configured in it I am in when not using VR. It has many useful buttons for loading common things like software for my motion platform, accessory programs, opening commonly used directories with config files, volume mixer for common apps etc. Certainly the screen on it is what makes it do what it does.

[Snake122]

(Doh!, I will leave what I wrote below but I see you were directly replying to Andrew specifically about the kneeboard!)

Yep, that! Your project is different application for sure, just throwing it out there for kneeboard usage like Andrew discussed :thumbup: