Finally after several week found the issue. My left VR controller was the main cause. When powering down the left VR controller the issue dissapeared. I looked in the controlls settings if there where any buttons attached to the controls. There weren't any, so i klicked Disable Vive controller.
I can still use my controllers ingame to manage the aircraft. But assigning buttons to it has been disabled. ( weren't using any of them so no problem )
Liger Zero's post in Control Jitter with several aircraft was marked as the answer