GottHold Posted March 15, 2016 Posted March 15, 2016 Hello fellow Pilots, I'm a media computer science student and this year i have to program a piece of software with an interactive sensor. So here comes my idea, the problems i have, and the help i need. Idea: I really get annoyed when i have to lift my hands off my HOTAS and go to the mouse push the mouse of ther button, hold my headstill to click with the mouse on it. Why not track down the Hands and give the User 2 possible modes for the user to just virtually click the buttons. 1 TrackIR Mode & 1 VR Mode. In TrackIR Mode, you point on the position on the screen where the button is you want to press with a gesture. In VR Mode you can just put your hands to the point where the button is. If you simulate a cockpit you could even give FC3 "clickable" cockpits Why: Because building your own cockpit is super expensive and that fits most likely only for 1 Plane. And as soon VR will impact the market we will have that huge Problem eitherway. Problems: How can my Software communicate with DCS to press the Button, or How to get Position of the button inside the Cockpit and for the TrackIR version on the Screen? How does Helios interogate with the buttons? My stage: I haven't programmed any DCS mod so far, but i have done many Unity, C#, Java, Js, Php, Matlab things before. So im kind of a dummy in modding DCS, but yet i know how to code. Im very pleased for every idea or any help you could give me to create that piece of software, since i wont be the only person annoyed by the mouse using. Cheers GottHold 1 Have a nice day!
SDsc0rch Posted March 15, 2016 Posted March 15, 2016 control of a virtual cockpit is a daunting challenge maybe not what you want to hear but.. i'm thinking maybe hardware analogs are better - generic aircraft panels with switches, levers and knobs for common aircraft functions and you could operate these physically - even memorize their locations and operate by feel alone (of course, the "see through" front-facing camera on the vive would be very helpful, even though i concede it would tend to disrupt the suspension of disbelief..) i7-4790K | Asus Sabertooth Z97 MkI | 16Gb DDR3 | EVGA GTX 980 | TM Warthog | MFG Crosswind | Panasonic TC-58AX800U [sIGPIC][/sIGPIC]
GottHold Posted March 15, 2016 Author Posted March 15, 2016 control of a virtual cockpit is a daunting challenge maybe not what you want to hear but.. i'm thinking maybe hardware analogs are better - generic aircraft panels with switches, levers and knobs for common aircraft functions and you could operate these physically - even memorize their locations and operate by feel alone (of course, the "see through" front-facing camera on the vive would be very helpful, even though i concede it would tend to disrupt the suspension of disbelief..) If you have switches, you still have the problem, it fits only for 1 plane. Thats why i want a multifunctional solution. And i need to work with that sensor eitherway so why not connect both things? Have a nice day!
SDsc0rch Posted March 15, 2016 Posted March 15, 2016 If you have switches, you still have the problem, it fits only for 1 plane. Thats why i want a multifunctional solution. And i need to work with that sensor eitherway so why not connect both things? you're right, that's why i said "generic aircraft controls" ----- things that are common to all aircraft ie.. landing gear, flaps, various lights, canopy, jettison stores, engine power on/off, maybe some extra wildcard items.. i7-4790K | Asus Sabertooth Z97 MkI | 16Gb DDR3 | EVGA GTX 980 | TM Warthog | MFG Crosswind | Panasonic TC-58AX800U [sIGPIC][/sIGPIC]
Darkwolf Posted March 15, 2016 Posted March 15, 2016 Go go either full virtual of full real. You just can't merge real panels with VR. [sIGPIC][/sIGPIC] PC simulator news site. Also....Join the largest DCS community on Facebook :pilotfly:
Darkwolf Posted March 15, 2016 Posted March 15, 2016 Problems: How can my Software communicate with DCS to press the Button, use the import/export lua option. It links directly to cockpit controls. Several solutions already exists, such SIOC, Helios.... How to get Position of the button inside the Cockpit I guess it would come down to create a database of position for everybutton. Button position may be found by checking the 3D models. and for the TrackIR version on the Screen? You probably better leave the mouse :P How does Helios interogate with the buttons? Helios has two way in : Either it gets in with export/import script, either direct keyboard emulation. To get a glance at how a cockpit script works, go into your DCS/mods/aircraft/any DCS plane/cockpit/script and study those scripts. [sIGPIC][/sIGPIC] PC simulator news site. Also....Join the largest DCS community on Facebook :pilotfly:
SDsc0rch Posted March 17, 2016 Posted March 17, 2016 found this this morning... Manus VR gloves i7-4790K | Asus Sabertooth Z97 MkI | 16Gb DDR3 | EVGA GTX 980 | TM Warthog | MFG Crosswind | Panasonic TC-58AX800U [sIGPIC][/sIGPIC]
Swoodle Posted March 31, 2016 Posted March 31, 2016 So Pebbles is a company that was developing hands in a virtual space. Basically you can see your hands in the virtual world and interact with virtual objects. Pebbles was bought by Facebook which I'm sure you all know owns Oculus. Demo of Pebbles [ame] [/ame] Lets face it. VR is 0yrs old, essentially this is the birth of it. It will take some time and a few years but things are definitely looking up. 1
Recommended Posts