Reports of Latency and Service Interruptions
Incident Report for Nexternal
Postmortem

We experienced a file system corruption on a load balancer in our environment. Our automated fail-over worked as expected, with our secondary device activating and adopting the responsibilities of the primary device. We were able to keep this device online as our team worked diligently to correct the issues with the primary device and restore service to normal as quickly as possible. We switched the active load balancer a few times during this period to make sure the configuration was correct, and closely monitored the network traffic. At times when the inactive device was made active, there was sporadic latency and lost data packets.

Posted May 29, 2019 - 15:23 PDT

Resolved
This incident has been resolved. We will update the issue with additional details once we have completed a root cause analysis.
Posted May 24, 2019 - 13:23 PDT
Update
We are continuing to monitor for any further issues.
Posted May 24, 2019 - 12:23 PDT
Update
We are continuing to monitor for any further issues.
Posted May 24, 2019 - 12:01 PDT
Monitoring
A fix has been implemented and we are monitoring results.
Posted May 24, 2019 - 11:34 PDT
Update
We are continuing to work on the issue and believe we are close to a resolution.
Posted May 24, 2019 - 11:00 PDT
Update
We are continuing to work on the issue and believe we are close to a resolution.
Posted May 24, 2019 - 10:31 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 10:12 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 09:51 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 09:27 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 09:03 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 08:30 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 08:11 PDT
Update
We are continuing to work on a fix for the issue.
Posted May 24, 2019 - 07:49 PDT
Identified
We are continuing to investigate the issue.
Posted May 24, 2019 - 07:28 PDT
Update
We are continuing to investigate the issue.
Posted May 24, 2019 - 07:02 PDT
Update
We are continuing to investigate the issue.
Posted May 24, 2019 - 06:41 PDT
Investigating
We are currently investigating reports of latency and interruptions with our service and will follow up with our next update in 20 minutes.
Posted May 24, 2019 - 06:20 PDT
This incident affected: Online Catalogs and Order Management Systems.