Email Event Log loading very slowly, seems tied to overall Email domain list health checks
-
Hello,
I've noticed the past couple of months when the few times I've needed to check the Email Event Log lately that the event logs loads very slowly, roughly 20-30 seconds to load any events. I think this coincides with the load time of the general Email domain lists which do the health-checks every time that page is loaded. Basically that takes a while, and in-turn seems to delay the Event Log loading even if I've already clicked off the Email page to the Email Event Log page.
FWIW, I have about 27 domains, a few are outbound only but most receive emails. That doesn't seem like too many to me but maybe it's starting to push the bounds of the Cloudron mail server health checks, not too sure about that. I think this all came as part of 7.6, but to be fair I haven't had to check the Email Event Log as often as I used to, so maybe I just hadn't noticed when it started for sure, may have been before 7.6 but pretty sure it was around the time of 7.6 roughly.
If there's anything I can do to offer any help in diagnosing the root cause and helping resolve it, please let me know. Thanks everyone.
@d19dotca said in Email Event Log loading very slowly, seems tied to overall Email domain list health checks:
I think this coincides with the load time of the general Email domain lists which do the health-checks every time that page is loaded. Basically that takes a while,
Are you referring to the indicators taking time or the "Loading...." thing ? The latter can be a bit slow, it has to ask dovecot for the mailbox size for each domain. Dovecot in turn has to calculate this by checking the size of each mailbox. So, it probably all adds up since it's based not just on domain count but also mailbox count!
-
I just found out: when you visit the Email setting page and wait until all domains are fetched with stats, THEN the next click on Event Logs is very quick.
It seems like the “fetching” in the Email page is still continuing while you wait for the results in the Event Logs. -
I just found out: when you visit the Email setting page and wait until all domains are fetched with stats, THEN the next click on Event Logs is very quick.
It seems like the “fetching” in the Email page is still continuing while you wait for the results in the Event Logs.@imc67 said in Email Event Log loading very slowly, seems tied to overall Email domain list health checks:
I just found out: when you visit the Email setting page and wait until all domains are fetched with stats, THEN the next click on Event Logs is very quick.
It seems like the “fetching” in the Email page is still continuing while you wait for the results in the Event Logs.Exactly what I’m seeing too.
@nebulon said in Email Event Log loading very slowly, seems tied to overall Email domain list health checks:
The email eventlog routes and view is independent of the health checks. Also the amount of domains as such should not matter. Essentially it is a a simple select query against a sqlite database in the mail container.
The db is at/home/yellowtent/boxdata/mail/events/log.dbmaybe you can check how large that one is in your instances?@nebulon I know you said it’s unrelated to the metrics collected and displayed on the main email page but it sure feels related based on timing of when the event log actually ends up loading data. If it wasn’t related then I’d expect to see very different timings, but I’m not. Perhaps just a coincidence but very much seems to be related.
-
G girish marked this topic as a question on
-
-
@d19dotca I might have misunderstood the original issue. You are referring to
/#/emails-eventlogcorrect ? Do you see the same 30 second delay if you click the refresh button (the one in the page and not the browser button) ?@girish I'm sorry for the late reply. Yes, I'm referring to the loading of the Event Log from the Email page, loading this URL: https://my.{domain}/#/emails-eventlog
The refresh button works fine after the main logs are loaded, but does not improve the situation at all when it's still doing the first page load of it.
You should be able to simulate this with these steps:
- Navigate to the
Email Event Logpage - Click on
Back to Emailbutton upper left corner - Quickly click back on the
Email Event Logpage and notice the slow delay
As I noted in my original post though, this seems to coincide with the RBL checks when loading up the initial Email page, as if showing the Event Logs can only occur after the RBL & DNS checks are done for each email domain. This means it likely isn't noticeable if only a few email domains are enabled. I'm not sure of the trigger point but in my situation I have 27 domains, it takes about 1-2 seconds for each domain to do the RBL & DNS checks, which relates to the ~30 second wait time it takes to load the Email Event Logs on the initial load. The steps above simply reproduce it, but even if I only went to the main Email page for the first time (new browser session) and quickly clicked the Event Log button, you'll notice this is delayed.
- Navigate to the
-
@d19dotca I might have misunderstood the original issue. You are referring to
/#/emails-eventlogcorrect ? Do you see the same 30 second delay if you click the refresh button (the one in the page and not the browser button) ? -
@d19dotca I think I will have debug this on your server directly. Can you please send a mail to support@cloudron.io ? I think as you said it's party related to have a large number of domains, since with 2-3 domains it's not really reproducible. From a cursory look at the code, the domain status is entirely async. But maybe something is blocking and I can't make out what it is.
-
@d19dotca I think I will have debug this on your server directly. Can you please send a mail to support@cloudron.io ? I think as you said it's party related to have a large number of domains, since with 2-3 domains it's not really reproducible. From a cursory look at the code, the domain status is entirely async. But maybe something is blocking and I can't make out what it is.
-
G girish has marked this topic as solved on
-
@robi @d19dotca identified the issue at https://forum.cloudron.io/topic/10434/email-event-log-loading-very-slowly-seems-tied-to-overall-email-domain-list-health-checks/9 . When we switch views, pending http requests of the old view are not canceled .
-
G girish referenced this topic on
