Jenmar VisualDLP Service Message Page
No Current Service Issues
Summary: Between 22:35 UTC and 23:30 UTC VisualDLP was unavailable for some users. The symptoms of the issue included slow and sometimes non-responsive loading for users logged into VisualDLP and inability to log in for others.
Root Cause: Azure DNS servers experienced an anomalous surge in DNS queries from across the globe targeting a set of domains hosted on Azure. Normally, Azure’s layers of caches and traffic shaping would mitigate this surge. In this incident, one specific sequence of events exposed a code defect in Azure DNS service that reduced the efficiency of our DNS Edge caches. As our DNS service became overloaded, Microsoft Azure experienced a DNS failure that affected many of their services, including those hosting VisualDLP
Mitigation: Microsoft Azure engineers have released an update to the DNS routing system to prevent
Summary: Between 17:50 UTC and :30 UTC New orders could not be added and changes to existing orders were not saving.
Root Cause: The search index used for searching and retrieving order information hit a quota due to an import of customer history records.
Mitigation: Increasing record quota to the next service level and create alerts to warn infrastructure teams when approaching limits.