history.rss

Jul 15, 17:24 UTC
Resolved - We've returned to normal levels of latency and error rates across all services.
Jul 15, 17:24 UTC
Update - We've returned to normal levels of latency and error rates across all services.
Jul 15, 17:18 UTC
Update - We are seeing improvement in latency across all services, and we have turned our voice agent back on. It is not accepting calls. We are continuing to monitor for stability.
Jul 15, 09:26 UTC
Update - We're still seeing unexpected load on our database, causing elevated latency and error rates. The team is continuing to investigate.
Jul 15, 06:23 UTC
Update - Our original fix did not have the intended effect. We've merged another fix and are again monitoring results to see if latency recovers.
Jul 15, 03:00 UTC
Monitoring - We've identified the root cause and merged a potential fix. We are monitoring for improvement.
Jul 15, 01:07 UTC
Update - We discovered that the elevated voice latency is due to increased latency from our database, affecting our web application and APIs.
Jul 15, 00:40 UTC
Investigating - We are investigating elevated latency with our voice agent and while this occurs, we are rerouting calls to live agents.

Jul 13, 18:53 UTC
Resolved - All APIs and the Assembled web application are fully functional.
Jul 13, 18:25 UTC
Monitoring - We've identified the root cause and are working on a potential fix, monitoring the results to see if this will restore latency and error rates.
Jul 13, 15:30 UTC
Investigating - We are experiencing an increase in latency and timeout-related errors on our web application and APIs. We are actively investigating.

Jul 10, 17:56 UTC
Resolved - Data affected during the period has been successfully retried.
Jul 10, 17:37 UTC
Monitoring - A fix has been implemented and we're monitoring our asynchronous services to ensure all data during the affected period is handled successfully.
Jul 10, 16:52 UTC
Identified - We have identified the root cause and are deploying the fix. Services are fully functional, but any services handling incoming data to Assembled were temporarily blocked.

Jul 09, 21:24 UTC
Resolved - This incident has been resolved.
Jul 09, 21:13 UTC
Monitoring - A fix has been implemented and we are monitoring the results.
Jul 09, 21:13 UTC
Investigating - We are investigating an interruption affecting the realtime agent analysis page. Our team is working on a fix.

Jun 10, 18:07 UTC
Resolved - Our engineering team has resolved the issue affecting agent states and tickets, applying agent state exclusions for affected customers.

Jun 04, 15:01 UTC
Resolved - All systems are confirmed fully restored and reporting data is displaying as expected.
Jun 03, 21:47 UTC
Update - Systems restored and data is displaying properly across all reporting pages. Monitoring continues.
Jun 03, 18:48 UTC
Update - Database functionality is improving, with scheduled jobs running to complete restoration.

...and so on, continuing with the rest of the incidents in the same structured fashion.