Server takes forever to log in

So for my hub server it seems to take quite a long time to log in for some reason.
And then also for some reason when joining my prison server, it also takes ages to join.
I have factions, skyblock, and prison and prison takes MUCH longer to join than the others
also this is all on one dedi to so not sure what the deal is, anyone have any ideas?