SkyEye - AI Powered GCI Bot - Talk to your AWACS over SRS!

[intruder11]

SkyEye is a Ground Controlled Intercept (GCI) bot. 

It is an advanced replacement for the in-game E-2, E-3 and A-50 AI aircraft

SkyEye is a substantial improvement over the DCS AWACS:

1. SkyEye offers modern voice recognition using a current-generation AI model. Keyboard input is also supported.
2. SkyEye has natural sounding voices, using a neural network to synthesize speech instead of robotically clipping together samples.
3. SkyEye adheres more closely to real-world brevity and procedures instead of the incorrect brevity used by the in-game AWACS.
4. SkyEye supports a larger number of commands, including PICTURE, BOGEY DOPE, DECLARE, SNAPLOCK, SPIKED , and ALPHA CHECK.
5. SkyEye intelligently monitors the battlespace, providing automatic THREAT, MERGED and FADED callouts to improve situational awareness.

SkyEye uses Speech-To-Text and Text-To-Speech technology which can run locally on the same computer as SkyEye. No cloud APIs are required, although cloud APIs are optionally supported. It works with any DCS mission, singleplayer or multiplayer. No special scripting or mission editor setup is required. You can run it for less than a nickel per hour on a cloud server, or run it on a computer in your home running Windows, Linux or macOS.

SkyEye is production ready software. It is used by a few public servers and many private squadrons. Based on download statistics, I estimate over 100 communities are using SkyEye, such as:

- Flashpoint Levant
- Victor Romeo Sierra
- DCS ANZUS

SkyEye is free software. It is free as in beer; you can download and run it for free. It is also free as in freedom; the source code is available for you to study and modify to fit your needs.

DCS ANZUS has made a nice demo video showing the bot in action:

 

 

Learn more:

• Check out the README and FAQ for an introduction
• Read the Player Guide to learn more about what the bot can do
• Read the Admin Guide to learn how to deploy it alongside your DCS server. The admin guide also includes quick-start guides to run it on a Windows server using OpenAI Platform, on an Apple Silicon mac, or on a Linux cloud server.

 

 

Edited April 23 by intruder11

[FlyingAlex]

2 hours ago, intruder11 said:

I am making an AI powered GCI bot for DCS. It uses fully local speech recognition and voice synthesis with no Cloud APIs or monthly bills required. The voice synthesis uses modern technology that sounds very human-like, similar to a commercial voice assistant or some newer AI voice clone technologies.

You can learn more at https://github.com/dharmab/skyeye - the bot is not yet ready but I am making rapid progress and I think you will all be able to try it before the end of the year. I hope I will be able to make a demo video in a few weeks but real life always takes priority of course. So no promises!

I do not check the DCS forums very often or use social media so forgive me if I don't reply. But feel free to follow updates to the GitHub repo!

 

Sound promising.  Look forward to the release!

[MAXsenna]

Oooh! Nice!

Sent from my SM-A536B using Tapatalk

[Panthir]

On 2/28/2024 at 2:00 PM, cfrag said:

 

Apologies, I'm not sure what I am seeing in the screenshot. It's also very close to an airfield, which makes me suspect that maybe I'm looking at an airfield zone? 

Can you reproduce the  issue on the cap by chute miz and send that miz back to me for analysis? With some luck it's only a silly oversight on my side.

 

 

10 hours ago, intruder11 said:

I am making an AI powered GCI bot for DCS. It uses fully local speech recognition and voice synthesis with no Cloud APIs or monthly bills required. The voice synthesis uses modern technology that sounds very human-like, similar to a commercial voice assistant or some newer AI voice clone technologies.

You can learn more at https://github.com/dharmab/skyeye - the bot is not yet ready but I am making rapid progress and I think you will all be able to try it before the end of the year. I hope I will be able to make a demo video in a few weeks but real life always takes priority of course. So no promises!

I do not check the DCS forums very often or use social media so forgive me if I don't reply. But feel free to follow updates to the GitHub repo!

 

Many thanks for your effort. I am looking forward to test it. 

[intruder11]

To provide a status update - things are going pretty well! The bot knows how to do some basic commands like RADIO CHECK, ALPHA CHECK, and BOGEY DOPE. I'm working on more commands like SPIKED, SNAPLOCK, DECLARE, and PICTURE. I usually test it by connecting the bot to a public server like Hoggit or Flashpoint Levant + my local SRS server and speaking commands to it while live-editing the code in my development environment.

On track for a winter 2024-25 release

[MAXsenna]

To provide a status update - things are going pretty well! The bot knows how to do some basic commands like RADIO CHECK, ALPHA CHECK, and BOGEY DOPE. I'm working on more commands like SPIKED, SNAPLOCK, DECLARE, and PICTURE. I usually test it by connecting the bot to a public server like Hoggit or Flashpoint Levant + my local SRS server and speaking commands to it while live-editing the code in my development environment.
On track for a winter 2024-25 release

I'm really looking forward to you publishing a test on YouTube!

Sent from my SM-A536B using Tapatalk

[intruder11]

[flag02004]

Well that's promising, but just a little remark, how does she knows that the 2 contacts are "Fishbeds" ? Hostile or unknown due to IFF, ok, but the type of the aircraft, not at all.

[intruder11]

It uses Tacview real time telemetry- anything you can see in the tacview, it can see. It'll be easy enough to make that a configurable option closer to release- it's just one line of code in the controller that sets that attribute, and the parts of the code that turn that into english language already know how to deal with that info being absent.

For pragmatism purposes I'm expecting most people will expect similar information as they get out of tacview, lotatc and sneaker GCI today to be available through the bot.

[flag02004]

Tacview is for debriefing only, so if you want to stay in the simulating area, some informations from Tacview must be masked or ignored. 

[intruder11]

Literally 99% of players don't care (per OverlordBot LOS usage statistics). If you do care, you can add the filters to the code, or try MOOSE Ops.AWACS which uses Lua to query the game's detection systems.

[intruder11]

Check out the player guide! It's a work in progress, but is a decent guide to what does and doesn't work so far.

https://github.com/dharmab/skyeye/blob/main/docs/PLAYER.md

[christopher m]

@intruder11

Well this will make the cold war assets MiG-15, MiG-19P, and others really come alive

looking forward to it, i'll definitely subscribe to your GitHub

i wonder did you ever see this bit of code for Precision Approach Radar? https://www.digitalcombatsimulator.com/en/files/3316509/

it was very interesting and i was wishing for further development

Best Regards,

 

 

GCA script mt_w_explanation.lua Precision Approach Radar.zip

[intruder11]

Sounds like https://paddles.contact/, maybe pitch the idea to them?

[christopher m]

@intruder11

It's more about Mig's and limited visibility landings and precision approach radars placed at the end of the runways

with control operators calling you in with approach vectors and little-high - High,  little-low - Low, and little-left - Left, little-right - Right calls to the

landing aircraft  when ILS is not an option.

BUT THNX anyway, I'll keep watching for your software release

Best Regards,

[intruder11]

Hello everyone,

Please check out the first monthly development newsletter for Skyeye!

https://www.8492sqdn.net/posts/newsletter-2024-08/

[mmarques]

I assume it would be impossible to integrate this into the in game radio system?

[intruder11]

That is up to ED to provide a way for external software to receive and transmit on the in game radio.

[intruder11]

Today brought a lot of good progress, including an enhanced callsign parser. It is adaptive and probabilistic- if it doesn't hear what you said perfectly, it's smart enough to look at context from the trackfile labels and figure out what you mean. e.g.:

- You mispronounce the GCI's callsign slightly (e.g. BADGER instead of BANGER)

- You mix up your own callsign (Viper 2-1 instead of Viper 1-2) and there isn't someone else using that callsign

- Your callsign is a homonym (Jester 1 vs Gesture 1) and there isn't someone else with the homonymic callsign

The incidence of "I could not find you on scope" is massively reduced.

[intruder11]

I completed all the features planned for the initial release over the weekend. Finishing up the automated builds and writing the documentation. There's also one annoying bug (the bot gets stuck when the DCS mission is changed/restarted). But if I don't figure that out in the next few days, I'll just include a workaround in the documentation.

[Linx]

Looking forward to trying it out!

[intruder11]

I've started passing out a release candidate privately. Barring any show stoppers, expect the LA release next week.

[intruder11]

I was working on installation automation and it was easier if I had an official release on GitHub. So there's now an official, pre-1.0 release!

[intruder11]

A new release has been published. Check out the changelog at https://github.com/dharmab/skyeye/releases/tag/v0.2.1

[intruder11]

The September development newsletter is now available: https://www.8492sqdn.net/posts/newsletter-2024-09/