2018-03-27 - Level 3 / Comcast Outage (Resolved)
Table of Contents
Incident Report:
Event Description: Level 3 / Comcast Outage resulting in poor call quality
Event Start Time: 2018-03-27 12:39:01 EST
Event End Time: 2018-03-27 14:13:24 EST
RFO Issue Date: 2018-03-27
Affected Services
Call quality, reachability to our portals
Event Summary
We've become aware of an issue affecting call quality and the reachability of our servers. This is due to national outages with Comcast and Level3. While we do not use those carriers directly, they do control most of the fabric that connects the internet across the United States. They are already aware and have given the outage their highest priority. We will continue to monitor them closely and will continue to report as we have updates. We apologize for any disruptions you may be experiencing.
Event Timeline
12:39:01 EST - First reports received
13:17:32 EST - Calls diverted to NYJ and LAS. Call quality clearing up. Continuing to monitor
14:13:24 EST - Routes impacting the Dallas node have subsided. We will be re-routing traffic directly to Dallas
Root Cause Analysis
Future Preventative Action