[Monitoring] IMAP and POP access issues

We are currently experiencing intermittent IMAP and POP access issues and our system administrators are investigating the cause.

We apologize for any inconvenience caused.

UPDATE 24.11.2022 18:30 CET (12:30 PM EST): We have adjusted authentication database configurations to increase the capacity of the authentication service, and we expect this to help prevent further access issues going forward.

UPDATE 2022-11-23 16:30 CET (10:30 AM EST): We have made further adjustments to the authentication service that should improve performance and are monitoring the results.

UPDATE 2022-11-22 19:50 CET (1:50 PM EST): After making adjustments to the authentication service configuration performance is improved and services are stabilizing.

UPDATE 2022-11-22 18:30 CET (12:30 PM EST): Work is ongoing along three dimensions:

  1. Investigating authentication related bottlenecks which may indirectly be affecting the entire service.
  2. Moving IMAP/POP pre-authentication services to separate, dedicated servers to offload IMAP/POP proxy servers.
  3. Assessing the need for additional hardware in order to scale the architecture horizontally.

UPDATE 2022-11-22 16:00 CET (10:00 AM EST): We are continuing analyses of timeout errors and considering options for improved balancing of server load related to IMAP/POP proxy connections.

UPDATE 2022-11-18 12:30 CET (6:30 AM EST): We are experiencing access issues and are investigating these. We apologize for the inconvenience caused.

UPDATE 2022-11-18 01:00 CET (2022-11-18 7:00 PM EST): After fixing a few post-deployment issues the IMAP and POP services have stabilized and are operating normally.

UPDATE 2022-11-17 08:30 CET (2:30 AM EST): We are planning to test the new pre-authentication software in production today. There might be intermittent instability during this deployment, which we will attempt to execute as smoothly as possible.

UPDATE 2022-11-15 18:00 CET (12:00 PM EST): In order to permanently resolve the problem we are now testing new pre-authentication software that should perform significantly better.

UPDATE 2022-11-14 22:00 CET (4:00 PM EST): We are continuing analyses of sever logs and adjusting configurations in order to resolve the authentication related bottlenecks.

UPDATE 2022-11-09 20:00 CET (2:00 PM EST): We have identified the likely cause to be a proxy mechanism between our IMAP/POP service and the authentication service, which causes problems during peak traffic hours. Our engineers are now working to improve or replace this software.

UPDATE 2022-11-07 23:30 CET (17:30 PM EST): We continue to investigate sporadic access issues affecting especially IMAP, and that appear related to authentication services and peak service hours.

UPDATE 2022-11-07 16:30 CET (10:30 AM EST): We are experiencing intermittent access issues and our system administrators are working to resolve them.

UPDATE 2022-11-02 20:30 CET (2:30 PM EST): Access has been restored and we are monitoring the situation.


Posted

in

by

Tags: