Good evening Ovrture users,
This document details the cause and events occurring immediately after Ovrture’s incident on November 15, 2019 as well as the steps we are taking to mitigate the impact of future outages like this one in the future.
On November 15, 2019, the API Ovrture uses with Kraken for image compressing affected the ability to upload image assets into the system. This degraded performance occurred from 11:40 AM. to 5:22 PM.
The Ovrture team was the first to notice this issue. Ovrture investigated the issue and discovered that it was occurring because of the problems that the image compression tool was experiencing. Due to unusually high demand, the compression tool’s cluster's performance had been degraded, with some requests failing. They had to provision new machines to resolve the issue.
Things we will improve to make sure issues like this do not happen again in the future:
-Ovrture will be exploring other options for image compression and have a backup system in place in case anything happens to the primary source.
We are very sorry for any inconvenience this incident may have caused on November 15 and we will continue to work hard to make sure something like this doesn’t happen again.
Gideon and the Ovrture Team