I have the same issue too, and probably more serious.
First of all my specs:
CPU: i5-8600K @ 3.6GHz
RAM: 16 GB DDR4 3000MHz
SSD: SanDisk
GPU: GeForce GTX 1080ti 11GB
When I go to the MP server 104th, I have to wait for at least 6 minutes before framerate go to stable, including about 2 minutes to enter player list, and 4 minutes to wait frame smooth(framerate is 0~20).
Is that my problem and how to resolve it?
P.S.
Attached screenshot of settings and log file. log.txt