Fingers - Leap hand tracking and physical switches for VR and others

[firefox121]

hace 2 horas, Indyplumber dijo:

When I click on the Fingers.exe it opens for a few seconds then shuts down.  I must be missing something.

Think you must run it in administrator mode, also have your leap motion device enabled and tracking

[Indyplumber]

Turns out I needed to enable bluetooth.  Now I'm in DCS but the mouse cursor stays off to the right.  Second monitor is turned off.  Anything else I can try?

[frenzon]

7 minutes ago, Indyplumber said:

Turns out I needed to enable bluetooth.  Now I'm in DCS but the mouse cursor stays off to the right.  Second monitor is turned off.  Anything else I can try?

If you could try the build linked in this bug thread and let me know if that works?

[Indyplumber]

1 hour ago, frenzon said:

If you could try the build linked in this bug thread and let me know if that works?

This worked.  I was able to utilize the finger mouse I bought from China.

 

https://www.aliexpress.us/item/2251832624920715.html?spm=a2g0o.order_list.order_list_main.5.21ef1802SMvZ50&gatewayAdapt=glo2usa&_randl_shipto=US

 

[rafalg78]

On 10/18/2022 at 8:53 PM, markbam said:

I really enjoy checking in and seeing what everyone else comes up with!

 

Here's my Version 2: Still not the prettiest, but much more compact and gave me a reason to play around with microcontrollers.

The board is a Seeed Studio XIAO BLE Sense nRF52840 running CircuitPython 8 and emulating both a keyboard and a mouse. (The chip has an IMU but I haven't integrated it for anything quite yet.)

The buttons are a 5-way hat switch: Up is Mouse Wheel Down: Down is Mouse Wheel Up: Left is Left Mouse Click: Right is Right Mouse Click: Press is ESC key.

I loved the feel of the haptics on my V1 (Switch Joycon) so I added a small motor that vibrates when I use the buttons. 

It charges a 50mAh battery via onboard USB-C that I connect with a magnetic cable to reduce wear. It lasts a full day of flying even with the haptics.

The ring was 3D printed out of TPU from a Ring Sizer on Thingiverse, It ended up being the perfect mounting system for my needs, so I didn't design anything further.

 

 

 

markbam, I really like your design, and Seeed Xiao BLE nRF52840 is more available and cheaper then Espruino.

I have quite limited experience with electronics but I think I'd like to give it a try.

Can you share a wiring diagram of your system? And some advices how to make it alive, I mean firmware loading.

 

 

[VR Flight Guy in PJ Pants]

On 7/7/2022 at 6:39 AM, markbam said:

 

Allow me to present my current setup for the "most ugly solution" award. It's bulky, but man, does it work well. Leap Gemini tracking has handled this like a champ and I have zero tracking issues (outside the ordinary). I even have haptics buzz on button presses and joystick movements.

 

 

Better than mounting the Elecom trackball on top of my index finger...

https://elecomus.com/web/product/handheld-bluetooth-thumb-operated-trackball-mouse/

Edited January 13, 2023 by VR Flight Guy in PJ Pants

[Goblin]

On 4/16/2021 at 9:20 PM, frenzon said:

custom-made five-direction button rings (the directions enable left click/right click/scroll up/scroll down/disable).

The rings are micro-USB rechargeable, and can handle six-eight hour sessions, with two weeks of standby time.

@frenzon, thanks for making fingers! It works really great! 
How can I get or make copies of your rings?

[frenzon]

New Fingers release here, with fixes for:

• Fix: Crash if Bluetooth is not enabled
• Fix: Multimonitor
• Fix: x-scaling issue in 2.8

Feedback always appreciated!

 

On 1/16/2023 at 1:07 AM, Goblin said:

@frenzon, thanks for making fingers! It works really great! 
How can I get or make copies of your rings?

Right now you are probably better off buying one of the rings others have linked in this thread - my rings work OK, but they are still fiddly to charge, and Microsoft's various BluetoothLE issues mean they're not as reliable as I'd like them to be for mass use.

I think an approach like what m0jo is doing (see up thread) is probably the right one where Windows can just see the device as a regular mouse and keyboard.

[VR Flight Guy in PJ Pants]

Rings, what rings? TL;DR, anyone would kind enough to make a summary, please?

[Japo32]

I have a problem with Fingers App. Id works while I am in the Varjo Desktop, but as soon as I enter DCS or other flight sim in VR the cursor is not moved when I move the hands. Even the cursor don't move a lot in the desktop resolution of 7680x2160. Does anyone have Varjo, and can test if it works for them?

[Tony86]

hey boys

i might be interested in buying frenzon ring

but where to buy it???

[Japo32]

ok.. my problem is gone, and now it is moving the cursor with fingers. But I have a problem. Now the mouse is not recognized. Is there any option to toggle fingers on/off or gemini programm so I can use or not the mouse while the camera are recoginizing my hands? if not I have to oclude the Leap motion camera with my hand. Thanks!

[Japo32]

The option I do (appart of the problem I have with Leap Motion that don't let me use the mouse for mouse wheel operations) is I mapped my toe brake pedals for Making appear the hands and left/right mouse clicks emulation. Those toe pedals are only used on ground and never on air, so on ground I would need the option to toogle the fingers app off to use my mouse. I need my hands on joystick while manipulating buttons and switchess on air.

So how did I do it on those toe pedals. They are axis so first you have to have pedals and checkout if they are recognized as buttons by Joytokey program. For example my Thrustmaster TPR pedals if my warthog joystick is not connected they are not recognized as buttons press. Then I enable all my joysticks in options of joytokey program and searh for what input is highlighted when I press the toe pedals. and use this configuration to make it work:

so I map in DCS shift+RCtrl+left arrow for left mouse emulation, shift+RCtrl+rightarrow for right mouse click emulation, Shift+Lctrl+space for making appear the left hand, and Shift+caplock to make appear the right hand. And I choose the option Switch depending on how long the button is pressed and give it 1000msecs so with quick presses of the toes I emulate mouse clicks and with long ones I make appear the hands or not.

With those toe brakes, I have the rest of my precious hotas buttons that never are enough free to be used in their respective real function and not interfere any of those functions the use of any button for the hands or mouse emulation clicks.

BUT  as said, I need an option to deactivate the fingers app when I want with a keyboard hot key, or better a mouse lateral button (ideal as it is going to be used, so allowed when fingers app is off)

[Japo32]

I have been trying to find a ring like @frenzonbuilt in first photos, but there is no luck. All are too big. If there is an oportuniity you can sell your rings it would be amazing. If possible with second button... to mimic left/right mouse clicks and up/down mouse wheel with longer press of those buttons in the Joytokey program. Of course for the left hand, as it is the one that is free while grabbing the joystick with the right one.

 

Edited January 25, 2023 by Japo32

[Eagle_01]

On 10/19/2022 at 11:14 AM, frenzon said:

Looking good! I love all these projects!

FWIW the reason I haven't made progress on the rings is that the chip shortage is really making it difficult - I'm now on my third type of nrf52 module (BMD-350), and that has also gone out of stock until sometime late next year so I keep having to redesign them, which, in combination with being slow and lazy, is making it take quite a while.

do you think these from Chiina would work?  Looks like they have a ton of them in stock.  And they are cheap

https://shopee.ph/product/308007443/20746646124?gclid=CjwKCAiArY2fBhB9EiwAWqHK6qfHUB6WXtinAY338_ukHBTaKDJAQ7j7vraKveVW2O9BpqrCJRA9gxoCVTsQAvD_BwE

[rafalg78]

Time to share my execution.

I used the Seeed Studio XIAO nRF52840 board with 4x tactile 6mm buttons, slider on/off switch and lipo battery 50mAh (21x8x4mm).

  

  

The 6mm buttons are sufficiently perceptible under the thumb, they do not confuse when using.

Rings are 3D designed and printed by me.

  

  

    

All run on CircuitPython connected by Bluetooth.

In my opinion Rings change the sense of using Leap Motion. Without Rings, I wasn't able to use the hand measure sensibly, it doesn't work with enough accuracy and sensitivity. Using the Fingers program sort of removes one of the degrees of freedom, and thanks to this sensitivity is no longer important, and the cursor positioning accuracy is sufficient.

 

In addition, I made 6 buttons, this time on a simpler Seeed Studio XIAO SAMD21 board. 

They are connected via a USB cable and visible in DCS as an additional controller with 6 buttons. They can be programmed directly in the DCS, and using Modifiers greatly increases the programming possibilities. The whole thing is also programmed in CircuitPython.

 

Edited February 24, 2023 by rafalg78

[James DeSouza]

I am interested in trying to put one of these ring mice together, but I have absolutely no knowledge of electronics.  What would be a good starting point?

[rafalg78]

4 hours ago, James DeSouza said:

I am interested in trying to put one of these ring mice together, but I have absolutely no knowledge of electronics.  What would be a good starting point?

I can share my source data, I mean 3D models for print, software and my experience with assembly. What you will have to do yourself is to print the models, buy parts, solder and upload the software.

I'm one of those waiting for PointCTRL, but after a few days of testing Rings and Motion Leap, I'll be giving up. Rings work reasonably well. The inconvenience that I have observed so far is the frequent need to pair bluetooth. However, after pairing, the connection is stable.

[James DeSouza]

4 hours ago, rafalg78 said:

I can share my source data, I mean 3D models for print, software and my experience with assembly. What you will have to do yourself is to print the models, buy parts, solder and upload the software.

I'm one of those waiting for PointCTRL, but after a few days of testing Rings and Motion Leap, I'll be giving up. Rings work reasonably well. The inconvenience that I have observed so far is the frequent need to pair bluetooth. However, after pairing, the connection is stable.

I was more meaning an absolute babies first steps kind of tutorial video series on youtube if you know of any good ones.  Like I know what soldering is conceptually but have no idea how to actually do it.  Or buying parts, I have no idea what parts are right or how to tell (I am actually trying to replace a wire in my throttle and not knowing what parts are right is a stumbling block :D)  I am looking at video tutorials myself but recommendations for good ones is alway useful.

[Sielu]

On 2/24/2023 at 9:14 AM, rafalg78 said:

Time to share my execution.

I used the Seeed Studio XIAO nRF52840 board with 4x tactile 6mm buttons, slider on/off switch and lipo battery 50mAh (21x8x4mm).

  

  

The 6mm buttons are sufficiently perceptible under the thumb, they do not confuse when using.

Rings are 3D designed and printed by me.

  

  

    

All run on CircuitPython connected by Bluetooth.

In my opinion Rings change the sense of using Leap Motion. Without Rings, I wasn't able to use the hand measure sensibly, it doesn't work with enough accuracy and sensitivity. Using the Fingers program sort of removes one of the degrees of freedom, and thanks to this sensitivity is no longer important, and the cursor positioning accuracy is sufficient.

 

In addition, I made 6 buttons, this time on a simpler Seeed Studio XIAO SAMD21 board. 

They are connected via a USB cable and visible in DCS as an additional controller with 6 buttons. They can be programmed directly in the DCS, and using Modifiers greatly increases the programming possibilities. The whole thing is also programmed in CircuitPython.

 

 

These are so epic it's not even funny, beautiful work!

[j9murphy]

@rafalg78maybe you could post your solution on instructables and/or thingiverse?

[rafalg78]

As the first instruction I prepared for additional buttons. The rings will be in a few days.

[rafalg78]

and Rings.

If something is unclear, please write, I will try to improve or clarify.

[randomguylurking]

@rafalg78 I've got everything hardwired, soldered and set up.  I've gotten Circuit Python installed, and "dropped" the code.py file into the drive, it reset but then nothing.  I'm unable to find it via bluetooth.  I've checked in IDE software and I saw in the terminal that BTLE was off, but can't figure out how to turn it on.  

I was able to run the example codes for "blinking" lights as outlined in the tutorials, but if I try to install anything related to Blue Tooth I get a compiling error about BlueFruit.h being missing.  I can't figure out how to install that library/header and think that may be the issue.

Any videos or help is appreciated!!! I'm at a standstill now with completely built hardware.  Thanks!!!

[firefox121]

For me, as I am a bit left handed to build anything, best option is this found years ago ...

https://es.aliexpress.com/item/1005004385216575.html?spm=a2g0o.productlist.main.45.7527576aNt85I4&algo_pvid=8f05e41d-051e-4fe4-a3d1-6be65b1e038c&algo_exp_id=8f05e41d-051e-4fe4-a3d1-6be65b1e038c-22&pdp_npi=3%40dis!EUR!17.71!6.02!!!!!%402102111816850522567445956d07ee!12000028993223709!sea!ES!4218856019&curPageLogUid=28eJ42rILTNb

 

Very useful with fingers app and with leapmotion, has left and right button also a scroll wheel .

See my post with photo attached to my finger above.