[REPORTED] - dedicated server dying without any apparent cause

[HC_Official]

Thanks HC_Official.

 

can I ask you to attach the full dcs log for the team.

 

thank you

 

No problem, the server is falling over more often than a one legged man in a bottom kicking contest so logs are not a problem

dcs.zip

[BIGNEWY]

thanks

[HC_Official]

looks like yesterdays patch is zeroing in on this issue ............ because it is hapening a lot more now

dcs.log-20201111-165724.zip

[HC_Official]

SCRIPTING: Error in timer function: [string "D:\games\3Develop_Moose_g.lua"]:35457: Task id missed

Gentlemen, all of your logs contain scripting errors. So, please check your missions and mods first.

 

 

No problem, I found the scripting error causing this and fixed it :-)

 

NO mods are being run on the server at the moment and I am using yesterdays new "hot fix" build and server is still crashing :-(

[Maverick87Shaka]

looks like yesterdays patch is zeroing in on this issue ............ because it is hapening a lot more now

 

I can confirm, the problem is still there with the latest build 2.5.6.57530.

Here the last part of my log before crash ( some data obfuscated for privacy ):

 

2020-11-11 20:56:58.624 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:00.583 WARNING LOG: 1 duplicate message(s) skipped.
2020-11-11 20:57:00.583 INFO DCS: wcTanker::onEvent:1
2020-11-11 20:57:00.584 INFO EDCORE: (wcTanker::Channel)enterToState_:2
2020-11-11 20:57:00.620 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:00.679 DEBUG Scripting: make: country: 2
2020-11-11 20:57:00.679 DEBUG Scripting: Phrases make : key = 4371
2020-11-11 20:57:01.622 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:10.962 WARNING LOG: 9 duplicate message(s) skipped.
2020-11-11 20:57:10.962 INFO SCRIPTING: *** Qeshm counter Attack Scheduler is alive: Nov 11, 2020, 21:57:11 ***
2020-11-11 20:57:11.622 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:12.895 WARNING LOG: 1 duplicate message(s) skipped.
2020-11-11 20:57:12.895 INFO SCRIPTING: *** AirToAirMenuScheduler / Air To Air is alive: Nov 11, 2020, 21:57:13 ***
2020-11-11 20:57:13.623 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:37.661 WARNING LOG: 24 duplicate message(s) skipped.
2020-11-11 20:57:37.661 INFO DCS: wcTanker::onEvent:6
2020-11-11 20:57:37.661 INFO EDCORE: (wcTanker::Channel)enterToState_:4
2020-11-11 20:57:37.756 DEBUG Scripting: make: country: 2
2020-11-11 20:57:37.756 DEBUG Scripting: Phrases make : key = 4372
2020-11-11 20:57:38.634 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:40.692 WARNING LOG: 2 duplicate message(s) skipped.
2020-11-11 20:57:40.692 INFO DCS: wcTanker::onEvent:9
2020-11-11 20:57:40.692 INFO EDCORE: (wcTanker::Channel)enterToState_:5
2020-11-11 20:57:40.787 DEBUG Scripting: make: country: 2
2020-11-11 20:57:40.787 DEBUG Scripting: Phrases make : key = 4375
2020-11-11 20:57:41.636 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:41.880 INFO DCS: wcTanker::onEvent:6
2020-11-11 20:57:41.880 INFO EDCORE: (wcTanker::Channel)enterToState_:4
2020-11-11 20:57:42.634 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:43.975 WARNING LOG: 1 duplicate message(s) skipped.
2020-11-11 20:57:43.975 INFO SCRIPTING: *** Qeshm counter Attack Scheduler is alive: Nov 11, 2020, 21:57:44 ***
2020-11-11 20:57:44.412 DEBUG Scripting: make: country: 2
2020-11-11 20:57:44.412 DEBUG Scripting: Phrases make : key = 4372
2020-11-11 20:57:44.633 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:45.036 INFO DCS: wcTanker::onEvent:9
2020-11-11 20:57:45.036 INFO EDCORE: (wcTanker::Channel)enterToState_:5
2020-11-11 20:57:45.635 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:46.068 DEBUG Scripting: make: country: 2
2020-11-11 20:57:46.068 DEBUG Scripting: Phrases make : key = 4375
2020-11-11 20:57:46.636 INFO SCRIPTING: checkHoverStatus
2020-11-11 20:57:47.917 WARNING LOG: 1 duplicate message(s) skipped.
2020-11-11 20:57:47.917 INFO SCRIPTING: *** AirToAirMenuScheduler / Air To Air is alive: Nov 11, 2020, 21:57:48 ***
2020-11-11 20:57:48.136 INFO NET: accepting connection from 7*.**.***.**6:53955
2020-11-11 20:57:48.161 INFO NET: adding client[2]
2020-11-11 20:57:48.318 INFO NET: added client[2] name=Tyros53 addr=7*.**.***.***:53955
2020-11-11 20:57:48.319 DEBUG NET: ServerInfo json size is: raw = 3662, gzip = 1342. 2 chunks.
2020-11-11 20:57:48.322 INFO EDCORE: try to write dump information
2020-11-11 20:57:48.324 INFO EDCORE: # -------------- 20201111-205748 --------------
2020-11-11 20:57:48.325 INFO EDCORE: DCS/2.5.6.57530 (x86_64; Windows NT 10.0.14393)
2020-11-11 20:57:48.325 INFO EDCORE: C:\Eagle Dynamics\DCS World OpenBeta\bin\lua.dll
2020-11-11 20:57:48.326 INFO EDCORE: # C0000005 ACCESS_VIOLATION at 3EE53E00 00:00000000

 

 

 

[HC_Official]

if there is not a real fix for this soon, it might be time to roll back to 2 patches ago

[Falcon_S]

One more crash log from today...

dcs.log-20201111-190026.zip

[Auntystatic]

hope someone can make use of this

 

020-11-12 00:55:47.707 INFO NET: accepting connection from 73.149.75.210:55280

2020-11-12 00:55:47.710 INFO NET: adding client[3]

2020-11-12 00:55:47.774 INFO NET: added client[3] name=BreadFarmer addr=73.149.75.210:55280

2020-11-12 00:55:47.777 INFO LuaNET: SLMOD INFO: connected client 3

2020-11-12 00:55:47.777 INFO LuaNET: SLMOD INFO: num clients: 3

2020-11-12 00:55:47.777 INFO LuaNET: [LOTATC] Player connect: 73.149.75.210

2020-11-12 00:55:47.777 INFO LuaNET: [LOTATC] Player connect done

2020-11-12 00:55:47.780 INFO EDCORE: try to write dump information

2020-11-12 00:55:47.780 ERROR Lua::Config: Call error onPlayerConnect:[string "./MissionEditor/modules/mul_select_role.lua"]:734: bad argument #1 to 'pairs' (table expected, got string)

stack traceback:

[C]: ?

[C]: in function 'pairs'

[string "./MissionEditor/modules/mul_select_role.lua"]:734: in function 'updateGrids'

[string "./MissionEditor/modules/mul_select_role.lua"]:447: in function 'onPlayerConnect'

[string "./MissionEditor/GameGUI.lua"]:697: in function <[string "./MissionEditor/GameGUI.lua"]:695>

(tail call): ?

(tail call): ?.

2020-11-12 00:55:47.781 INFO EDCORE: # -------------- 20201112-005548 --------------

2020-11-12 00:55:47.782 INFO EDCORE: DCS/2.5.6.57530 (x86_64; Windows NT 10.0.18363)

2020-11-12 00:55:47.783 INFO EDCORE: C:\WINDOWS\SYSTEM32\ntdll.dll

2020-11-12 00:55:47.784 INFO EDCORE: # C0000028 An invalid or unaligned stack was encountered during an unwind operation.

 

at B0C5BE48 00:00000000

2020-11-12 00:55:47.786 INFO EDCORE: SymInit: Symbol-SearchPath: '.;C:\Program Files\Eagle Dynamics\DCS World OpenBeta;C:\Program Files\Eagle Dynamics\DCS World OpenBeta\bin;C:\WINDOWS;C:\WINDOWS\system32;SRV*C:\websymbols*http://msdl.microsoft.com/download/symbols;', symOptions: 530, UserName: 'Dani'

2020-11-12 00:55:47.787 INFO EDCORE: OS-Version: 10.0.18363 () 0x100-0x1

dcs.log.zip

[Flappie]

2020-11-12 00:55:47.780 ERROR Lua::Config: Call error onPlayerConnect:[string "./MissionEditor/modules/mul_select_role.lua"]:734: bad argument #1 to 'pairs' (table expected, got string)

stack traceback:

[C]: ?

[C]: in function 'pairs'

[string "./MissionEditor/modules/mul_select_role.lua"]:734: in function 'updateGrids'

[string "./MissionEditor/modules/mul_select_role.lua"]:447: in function 'onPlayerConnect'

[string "./MissionEditor/GameGUI.lua"]:697: in function <[string "./MissionEditor/GameGUI.lua"]:695>

(tail call): ?

(tail call): ?.

Well, that is new. Here's line 734, in blue:

 

[color=#2980b9]for k,v in base.pairs(blueSlotsTMP) do[/color]
v.airdromeName = getAirdromeName(v)
base.table.insert(blueSlots, v)
end

 

where blueSlotsTMP equals 'DCS.getAvailableSlots("blue")'

[trampi]

Unfortunately we also got a big increase in server crashs on our servers starting with the first november update.

We did update LotATC and we're using TacView. Edit: We're not using SLMOD

 

Please ignore most of the mission scripting errors, as they were there months before without crashing the server.

 

At least in this specific case, the error happens when someone is joining the server.

dcs.log-20201111-164825.zip

[philstyle]

Please ignore most of the mission scripting errors, as they were there months before without crashing the server.

 

I would like to re-iterate this point. The log errors relating to some scripts have been with us for months and have never caused crashes before.

We rolled the Storm of War server back to the release version 36 hours ago. We have not had a single crash since doing so.

Here is a link to the log. You can see there are still scripting errors. Yet, no crashing.

 

https://drive.google.com/file/d/1Fv1f59grwfqfJD_HWUsWDIL09JVhuCPh/view?usp=sharing

[trampi]

Had a glimpse at the other crash logs. Seems like we're not the only one's having the crashs happening contemporary to players connecting with servers or choosing player slots.

[HC_Official]

I have fixed the single script that was generating an error in the log, I wonder can ED maybe look at the 1,00s of other error messages generated by DCS in the log file now (even before MP is up and running)?

This crash best as I can tell has nothing to do with scripts or mods (as I have removed SLMOD from the server)

 

It is like something is wrong in the net connecting code when a new player joins a server

It might be time for ED to start to perform some testing on DCS builds in Multiplayer, even some basic sanity testing might be useful, just a suggestion mind you

[Maverick87Shaka]

I have fixed the single script that was generating an error in the log, I wonder can ED maybe look at the 1,00s of other error messages generated by DCS in the log file now (even before MP is up and running)?

This crash best as I can tell has nothing to do with scripts or mods (as I have removed SLMOD from the server)

 

It is like something is wrong in the net connecting code when a new player joins a server

It might be time for ED to start to perform some testing on DCS builds in Multiplayer, even some basic sanity testing might be useful, just a suggestion mind you

 

I don't want going Off Topic, but I definitely agree with this, multiplayer is a crucial part for overall experience of the simulator. You can put as much effort as you can trying to recreate detailed systems and simulation, but if it's crash on multiplayer it's not really going to care so much for final users.

 

I was also little bit confused since not so much times ago ED announce a new wave of closed beta tester to help to figure out more problem before delivery even the Open Beta build. So far it looks that most of the server admins that normally are trying to report bug, are still "outside" this closed test, and they have to post here on forum every time for some blocking issue after OpenBeta release.

 

BTW, it's another topic so I really don't want to start this discussion here, but ED please note that it's should be considered a really blocking issue, we're here to help to identify the problem.

 

Regards.

[HC_Official]

 

I was also little bit confused since not so much times ago ED announce a new wave of closed beta tester to help to figure out more problem before delivery even the Open Beta build. So far it looks that most of the server admins that normally are trying to report bug, are still "outside" this closed test, and they have to post here on forum every time for some blocking issue after OpenBeta release.

 

Regards.

 

I think the bar for being a DCS open beta tester is pretty high, I applied to be one and didn't even get a reply back. I have been testing software since 1998 as my full time job, so I do know a bit about how to do it

 

I wish the dcs.logs gave out a bit more info that might help ED track this down quickly

 

[BIGNEWY]

 

I think the bar for being a DCS open beta tester is pretty high, I applied to be one and didn't even get a reply back. I have been testing software since 1998 as my full time job, so I do know a bit about how to do it

 

I wish the dcs.logs gave out a bit more info that might help ED track this down quickly

 

Have you enabled full debug logs? https://forums.eagle.ru/forum/english/digital-combat-simulator/dcs-world-2-5/bugs-and-problems-ai/game-crash-ad/267879-enable-full-debug-log-with-your-autoexec-cfg

 

thanks

[HC_Official]

 

Have you enabled full debug logs? https://forums.eagle.ru/forum/english/digital-combat-simulator/dcs-world-2-5/bugs-and-problems-ai/game-crash-ad/267879-enable-full-debug-log-with-your-autoexec-cfg

 

thanks

 

Yes indeed I have made those changes to my autoexec.cfg config file

[MobiSev]

Yeah, it's strange. It isn't every time that it crashes when someone joins. It just does it randomly, but it's pretty often and always when someone tries to connect to the server.

[Falcon_S]

 

Have you enabled full debug logs? https://forums.eagle.ru/forum/englis...r-autoexec-cfg

 

thanks

 

After i add that

log.set_output("dcs", "", log.ALL, log.FULL)

in my autoexec.cfg no crash log after server crash. Is crashed again but no log at all.

[HC_Official]

and again

dcs.log-20201106-192734.zip

[HC_Official]

Server Hosters:

Note that each time the server craps itself it will create a large *.hdmp file, *.dmp and also some *.mdmp files .... these will take a lot of hard drive space

you might want to delete them , it was at 17Gigabytes on my server

[philstyle]

Server Hosters:

Note that each time the server craps itself it will create a large *.hdmp file, *.dmp and also some *.mdmp files .... these will take a lot of hard drive space

you might want to delete them , it was at 17Gigabytes on my server

 

where are these being saved?

 

[Alpenwolf]

Another server's crash... Please, tell me there's a hotfix tomorrow. Log file here.

 

Godspeed, ED!

[Flappie]

Guys, can one of you try to run a "classical" mission instead of custom missions? (Through The Inferno, for instance)

[Chandawg]

RSR (Red Storm Rising) has also been plagued with the crash on client connection, since release of the patch and the hotfix.

2020-11-12 23:38:41.350 INFO Scripting: event:type=takeoff,initiatorPilotName=Whiskey,place=Al-Dumayr,t=49072.165,placeDisplayName=Al-Dumayr,initiatorMissionID=523,
2020-11-12 23:38:42.275 INFO Scripting: event:type=engine startup,initiatorPilotName=huggie_face,place=Damascus,t=49073.1,placeDisplayName=Damascus,initiatorMissionID=1219,
2020-11-12 23:38:47.986 INFO Scripting: event:weapon=9M311 Tunguska (SA-19 Grison),t=49078.812,type=shot,initiatorMissionID=1001009,
2020-11-12 23:38:50.250 INFO Scripting: event:type=eject,t=49081.065,initiatorPilotName=SkyLab,initiatorMissionID=1221,
2020-11-12 23:38:50.250 INFO Scripting: event:targetPilotName=SkyLab,type=kill,initiatorPilotName=ROGUE | Leumi,weapon=R-27ET (AA-10D),target=F-16C_50,t=49081.065,initiatorMissionID=2513,targetMissionID=1221,
2020-11-12 23:38:50.250 INFO Scripting: event:amount=50,t=49081.065,type=score,initiatorMissionID=2513,
2020-11-12 23:38:50.251 INFO SCRIPTING: Event unit - Pilot Ejected
2020-11-12 23:38:50.253 INFO Scripting: event:t=49081.065,type=birth,initiatorMissionID=2701,
2020-11-12 23:38:50.270 INFO LuaNET: kill3Su-2719F-16C_502R-27ET (AA-10D)
2020-11-12 23:38:50.678 INFO NET: accepting connection from 73.112.46.129:55780
2020-11-12 23:38:50.687 INFO NET: adding client[8]
2020-11-12 23:38:50.734 INFO NET: added client[8] name==AW=33COM addr=73.112.46.129:55780
2020-11-12 23:38:50.742 INFO EDCORE: try to write dump information
2020-11-12 23:38:50.747 INFO EDCORE: # -------------- 20201112-233851 --------------
2020-11-12 23:38:50.748 INFO EDCORE: DCS/2.5.6.57530 (x86_64; Windows NT 10.0.19041)
2020-11-12 23:38:50.748 INFO EDCORE: C:\Program Files\Eagle Dynamics\DCS World OpenBeta Server\bin\lua.dll
2020-11-12 23:38:50.749 INFO EDCORE: # C0000005 ACCESS_VIOLATION at 6CBB1F2E 00:00000000
2020-11-12 23:38:50.750 INFO EDCORE: SymInit: Symbol-SearchPath: '.;C:\Program Files\Eagle Dynamics\DCS World OpenBeta Server;C:\Program Files\Eagle Dynamics\DCS World OpenBeta Server\bin;C:\Windows;C:\Windows\system32;SRV*C:\websymbols*http://msdl.microsoft.com/download/symbols;', symOptions: 530, UserName: 'RSRAdmin'
2020-11-12 23:38:50.751 INFO EDCORE: OS-Version: 10.0.19041 () 0x100-0x1

 

dcs.log-20201112-042907.zip

dcs.log-20201111-204642.zip

dcs.log-20201111-002442.zip

dcs.log-20201112-110410.zip

dcs.log-20201112-233939.zip

dcs.log-20201111-231539.zip

dcs.log-20201111-171441.zip