Virtual Stream Deck

[Veteran66]

now you can get Virtual Buttons on Windows Deskop, with "Virtual Stream Deck (Beta)"

work good

Link:
https://www.elgato.com/de/de/s/virtual-stream-deck?utm_source=social-media&utm_medium=organic-social&utm_campaign=stream-deck&utm_term=all-regions&utm_content=elgato

[AndyJWest]

Interesting. Note that you need to own a physical Stream Deck device to 'unlock' this. 

Reddit thread: https://www.reddit.com/r/elgato/comments/1kqq3b1/beta_megathread_virtual_stream_deck_onscreen/

I'm not sure how useful it will be in a DCS context, since you'll have to use the mouse to click the virtual 'buttons' (or place the virtual Stream Deck on a touchscreen monitor maybe?). There may be situations where it makes sense though. I'll maybe experiment a bit. I'd be interested to see what other people do with it.

 

Edited May 24 by AndyJWest

[arkantos.pt]

you can bind the VSD hotkey to a hotas key, with tobii eye tracker, you can select which button on the VSD to select. Although my experience is that long-term use of IR (at least Tobii) eye tracking will make you experience your eyes tired after some 15 minutes.
Beam eye tracking seems to use only normal light spectrum to track eyes, if iam not mistaken, but iam not sure if they have a selection cursor feature at this point. I know academic tobii eye tracking software gives that possibility. And it is being used for paralyzed people to be able to do actions on a screen, like for example it tracks your eyes and once you stop and keep 300-500 ms staring at a button/letter, selects that event.
If you have a keypad right next to the joystick or throttle, right or left of it, you can emulate each key for each button on VSD, and you just have to do a quick shift with your hand to the pad to press the button, which will emulate the VSD button.
Or, as you said, you can use a tablet as the VSD.
I think in the near future someone will come up with a proper fingertracking, not bulky, like some available, which you can use together with the joystick without problems, and/or do handtracking and fingertracking with front-webcam/IR-camera, as VR cameras do, by reversing the front-facing webcam image with DL algorithms. You can also place a small-touchpad right in front of the base of the joystick, and it would be easy to do mouse tracking functions needed. Or, someone could invent even a mini touchpad on the joystick throttle, just below the gun trigger. Like the small oled screens of keyboard or smartwatches that you slide your finger several times and could be used to move a cursor fast. or select options, slide to cycle between options, touch press to choose.
Actually, with all IR cameras, like tobii, trackIR, delanclip, it would be quite simple to implement it if you think wisely. You just need to place an IR led on the distal phalanx and another on the proximal phalanx, of the index finger, and not only it will track your finger/hand, as it will track when you click, because the telemetry between the two reference positions of the leds in the phalanxes will tell when you are closing or extending the finger/hand. Instead of IR-leds, it could be used other sensors, such as acelerometers or something like that.

Aero cursor tracking is easy. you have that for example on any smart Tv remote nowadays. You just needed to implement it with the finger as well. It would be easy to put it on a fingertip instead of a remote or smartphone.

It's stupid you need to buy a elgato hardware for this. I am pretty sure some third-party software with same functionality already exists or if not, it will exist shortly.
I mean, overlays with hotkeys are around for ages. They cannot demand IP there.

Edited Wednesday at 11:24 AM by arkantos.pt