BRIX - Network issues between our datacenter and AWS

Incident Report for External Status Page

Postmortem

Postmortem Report: Connectivity Outage Due to Bad Fiber Cable

Date of Incident: August 12, 2024

Impact:

  • Affected Services: BuildPro – API, BuildPro – Website, Integration – API, SupplyPro GM - Website

Summary: On August 12, 2024, a connectivity issue occurred due to a faulty fiber cable. This resulted in sporadic network issues between our datacenter and primary internet provider.

Root Cause: The cause of the outage was a faulty fiber cable located in our datacenter. The cable was found to be providing degraded bandwidth between our systems and the datacenter’s meet-me room.  This resulted in sporadic connectivity issues for the above services.

Resolution: A datacenter technician ran a new fiber cable to replace the faulty one. Post-replacement tests confirmed that the connectivity issues were resolved.

Posted Aug 19, 2024 - 16:07 CDT

Resolved

The network issue has been resolved.
Posted Aug 12, 2024 - 20:35 CDT

Identified

We are having sporadic network issues between our datacenter and AWS. This This is affecting BRIX integration. This is very intermittent. We have identified the root cause and are working on a fix. We are seeing sporadic errors exporting information out of BRIX into BuildPro. Please use the BuildPro integrate buttons to retry exports.
Posted Aug 12, 2024 - 16:24 CDT
This incident affected: BRIX.