[Resolved] Unscheduled maintenance

We are performing unscheduled maintenance on a storage unit in order to resolve performance issues.  We expect a short downtime window of around 10 minutes, which will affect some users’ access to their email accounts.

We apologize for the inconvenience and expect services to be fully operational again shortly.

UPDATE 16:15 CET: We are continuing maintenance work on the storage unit. The configuration changes that were made did not produce satisfactory results and are now replacing SSD disks with higher performance ones. This is causing varying performance for some users especially via IMAP and POP. We expect the situation to improve within 30 minutes.

UPDATE 16.30 CET: The configuration changes that were made did not produce satisfactory results and have started replacing SSD disks with higher performance ones. This should gradually improve performance but is causing varying performance for some users especially via IMAP and POP while the replacement is ongoing. 

UPDATE 16.45 CET: We are now suspending the SSD replacement in order to not impact performance negatively during peak hours, and will resume tomorrow morning CET.

UPDATE 09.02.2021 17:00 CET: The remaining SSDs have been replaced and work is suspended until tomorrow morning.

UPDATE 11.02.2021 14:30 CET: We have completed the rebuilding of data and logs after replacing the SSDs, and storage unit performance appears to have improved. There are however still intermittent load spikes on IMAP/POP servers that appear related to storage servers, and we are considering additional measures to improve this further.

We apologize for any inconvenience caused while this work is ongoing.


Posted

in

by

Tags: