leapMotion implementation possibility

[TED]

I tried it again yesterday with the spitfire and it was basically unusable as it kept interfering with the stick and sending me into uncontrolled maneuvers. I really want to see this work in dcs. I’m optimistic it can and will be done. 

[Swson]

On 5/26/2021 at 9:51 AM, tigger6 said:

I have a LeapMotion controller stuck on the front of a G2. When I run the LeapMotion app, (using the Gemini drivers), hand tracking is nearly perfect. However when I start DCS, the hands that appear are very poorly tracked in comparison. The pimax has the newer wide FOV hardware so it could be better, but it seems the trouble does not lie in hardware but steam driver or refresh rate or something like that.

I have exactly the same behavior tracking perfect with leap software and very poor in DCS very sad…..

On 7/5/2021 at 7:40 PM, TED said:

I got my Leapmotion controller today. After reading a lot online and on this forum, i really was not expecting much at all, and it was more out of interest than anything else. I had seen ED were starting to support it, but again fairly low expectations.

However I was somewhat surprised and positively surprised at that. I plugged it in straight away. A very simple process, requiring one USB plug, stuck the controller onto the front of my reverb g2, downloaded the software and fired up dcs. 

Basically it worked straight away. My hands visible, moving and doing pretty much what i told them to do. I was, after a little practice able to fairly easily get around the cockpit and activate all the switches. I did a full start up, a short flight with some a2g missiles operating a few systems, and a full shutdown after, all just using the leapmotion. I had no issues at all with the hands interfering with the controls as I am using physical controls. As a very early implentation into DCS I was pretty impressed. There are certainly plenty of areas for improvement, but based on my test, nothing that shouldn’t be possible with some coding and firmware. Unfortunately I have zero experience in any of this and will be relying on community developments and DCS updates. The first thing that probably it needs, and quite possibly exists already, is a simple way to customize the control gestures. The only thing really we need for dcs is to be able to point a finger and click. This is basically possible right now, but there are so many other gestures it picks up, it can get a bit confused and start to wander. I did find it a little too sensitive, so a way to dial this way down would be a big improvement. I would ideally like to have the option of effectively just using this as a mouse. A pointed finger could therefore physically move certain switches and buttons and those that can’t be reached the laser pointer from a finger and a simple click will be perfect.

All in all I am absolutely thrilled DCS has picked this up and I think if they can make some small adjustments to the implementation within DCS it is going to be pretty much a standard for anyone using VR. It has massive potential, and seems to be a relatively low hanging fruit to get working well fairly quickly. For me already, my hand controllers are now ditched and i will be only using the hand tracking. For those times I can’t get it exactly right, I still have the mouse. Can’t wait to see how this progresses.

Did you succeeded suppressing the pointers laser like rays? Even with the option deactivated in Special area, they stay alive and interfere severely with my fingers position and actions

[Swson]

On 7/20/2021 at 10:06 AM, Fisu_MAD said:

+1000

How do you deactivate pointers? Even with option tick off they stay there….

[Fisu_MAD]

New update, in spanish of course (https://en.wikipedia.org/wiki/List_of_languages_by_number_of_native_speakers)

If you dont understand, sorry, maybe its time to learn a bit XD.

Feliz Navidad!

 

[Dodge]

• Leap motion gemini 5.2 drivers. Users may need to update their leap motion drivers to the latest gemini drivers.

https://www.digitalcombatsimulator.com/en/news/changelog/openbeta/2.7.9.17830/

[Fisu_MAD]

mmmmm, thum option press dont work as spected. When you choose the thumb option some times the pointer appear, and only works this way. Then  playing with the options some times thumbs press works @BIGNEWY

[BIGNEWY]

More work to be done for sure and we are working closer with leap in this regard. But it will take time, so fingers crossed for 2022 and beyond. 

[gianlu320]

I was trying again the leap motion (Ultra leap) hand tracking.

I have a pimax8k with their hand tracking module and I installed the new ultraleap Gemini software.

My problem is this, I go in DCS options, specials page, I activate the leap motion hand tracking but I don't close the specials page.

The hands work perfectly, they are both tracked perfectly.

As soon as I go out of the specials page and I restart flying, the hands are erratical, they appear and disappear randomly, most of the times only one hand is shown, the tracking is very poor.

Anybody with a pimax or even non pimax experienced anything similar?

[Colmillo]

19 minutes ago, gianlu320 said:

I was trying again the leap motion (Ultra leap) hand tracking.

I have a pimax8k with their hand tracking module and I installed the new ultraleap Gemini software.

My problem is this, I go in DCS options, specials page, I activate the leap motion hand tracking but I don't close the specials page.

The hands work perfectly, they are both tracked perfectly.

As soon as I go out of the specials page and I restart flying, the hands are erratical, they appear and disappear randomly, most of the times only one hand is shown, the tracking is very poor.

Anybody with a pimax or even non pimax experienced anything similar?

Hi
Yes, same problem with 8KX

 

[gianlu320]

@Colmillo

Thanks for confirming this..

I don't think this is a pimax hand tracking module problem or Gemini software problem because the tracking in the Gemini visualizer is perfect and it's perfect even in DCS when you are in the specials page.

But when in cockpit it doesn't work at all with all the symptoms as in post above, I suspect the problem is on DCS side but obviously I can't be sure.

Hopefully ED can take a look when time permits...

 

 

[edmuss]

The leap hands will turn off if you put in a stick or throttle input, typically the right hand will be hidden more though. Try setting a dead zone for the stick, quite often the centre point still registers enough of an input to hide the hands.

For erratic tracking you need to have a clearly defined hand outline for it to keep track. If surfaces behind your hands are reflecting too much of the IR light then it will prevent ultraleap from tracking. I used self adhesive closed cell foam sheet to absorb the IR light and it tracks perfectly. Look in the visualiser and look for white surfaces, these are what you want to get rid of.

[gianlu320]

@edmuss

Thanks a lot for your suggestions.

For what regards the hands disappearing when applying any input, I don't think this is my case because this happens even on ground stationary with engines shut but you gave me an idea.

As you say I might still have some input from not perfectly centered stick so I will load Dcs with my stick and throttle usb detached and let's see what happens.

For what regards reflections, yes I have a big screen in front of me and for sure this is a reflection source but what I don't understand is why does it work flawlessly in the visualizer or Dcs specials page but not in game?

Can you confirm you are using a pimax as well?

Once again thanks for the help

I will try to troubleshoot and I will report back here

[edmuss]

I'm using a G2 and separate leap motion.

You might be surprised about the monitor, I don't think they reflect that much IR. The big one for me was wooden surfaces of my desk and the wall.

Generally it will be close surfaces that reflect the light.

[gianlu320]

@edmuss

You gave me big help and pointed me to the right direction.

With my stick and throttle usb detached, the hands work flawlessly so I think you are correct, one of them or both make some input even when at rest.

I will now try to figure which one it is and try to fix it.

For what regards reflections, I covered my screen with a towel while in vr but it doesn't make any noticeable difference.

Once again thanks a lot for your help...

@Colmillo hopefully you read this, it might help you as well

[A.F.]

I bought equipment from Virpil in the hope that my hands would show up again after I made an entry on the stick. But unfortunately that doesn't work.
The disappearance of the hands is really annoying.
 

HP Reverb G2

Edited October 2, 2022 by A.F.

[edmuss]

I've just added dampers to my stick so it behaves as a cyclic and doesn't centre itself, the only problem with that is the right hand is almost constantly hidden because the stick is never centralised.

As a test I turned in hand to use control stick (which keeps the hands visible all the time) and it doesn't seem to be grabbing the virtual stick like it used to. Perhaps something to try?

[gianlu320]

I think it's good that the hands disappear if an input is applied but this should be chosen as an option.

And there should be other options to make the hands appear/disappear when a switches are pressed or throttle and stick, in other words the handtraking should be fully customisable.

Hopefully ED will continue working on this

[tomeye]

I quit trying with leap motion before summer, it was being constantly inconsistent and hands were visible while on controls. Has there been any major update to the software and implementation?

[edmuss]

I think there are always small tweaks being done in the background. Nothing is ever documented in the patch notes but it's gradually getting better all the time.

With my stick dampers fitted I need to have the option for the right hand to control the virtual stick.

My previous experience of using this setting has been terrible because as soon as the glove got near the grip it would snap on and then any further hand movement would move the virtual stick and apply input as such (whilst also taking control input from the physical stick). It generally resulted in a complete loss of control.

During my brief testing last night I couldn't get the gloves to grab the virtual stick at all so I guess the functionality has been tweaked. It's quite possible that the gloves interacting with the virtual hotas has actually been disabled all together and now it's a case of hide the hands with control input; just the options haven't been relabelled as such.

In a way this is a better setup because whilst it's cool using just your hands on a virtual hotas you have no ability to press any of the hotas buttons which sort of defeats the objective of having a hotas in the first place

[TED]

Has anyone else had issues with leapmotion in windows 11? Since upgrading I can’t get the software to work at all. It basically doesn’t even activate. I cannot even open the visualizer. 

[dureiken]

27 minutes ago, TED said:

Has anyone else had issues with leapmotion in windows 11? Since upgrading I can’t get the software to work at all. It basically doesn’t even activate. I cannot even open the visualizer. 

No problem wih win11 here

[TED]

I can't even get the tracking software to open. Spent 2 days going through everything and since updating to latest Gemini just won't open. 

The controller is showing connected in devices and green light is on but something is preventing any of the software and services from opening. 

Checked all firewalls and antivirus, run as administrator, all permissions checked. Can't think of anything else.