On July 11th, at 11:00 CT, Alert Logic Engineering Teams executed a scheduled change to introduce feature improvements for customer IDS appliance reporting. This change was executed successfully for most customers by 20:00. However, as a result of this change, a small number of customers on previous versions of appliance software would have experienced an unforeseen issue with appliance statistic reports in the Alert Logic console.
The change in question did plan for appliance versioning and was intended to be released to the newest version only, but the executed release inadvertently included older appliance versions. This resulted in a subset of customers with previous versions falling in scope of the change and introduced an error in appliance statistics. This issue does not affect security availability or services, only statistics.
For those customers affected, the Dashboard, Reporting and Appliance sections of the Alert Logic console would have presented inaccurate figures during the period of the change window. Any statistical information not reported during this period is not recoverable retrospectively, for presentation in the Alert Logic console. No customer data, including event and incident creation, was lost as a result of this oversight.
Engineering teams identified the issue by 21:00 and a break-fix effort was executed to restore statistical data transport to the Alert Logic console. Customer statistical data transport would have resumed between the period of 23:00 and 05:00 on July 12th, depending on the sequence of the appliance roll-out.
Posted Jul 12, 2019 - 14:59 UTC
This incident affected: US-West-1 (Alert Logic console, Network IDS).