Major service outage
MAJOR Closed Broadband and Ethernet
STATUS
Closed
CREATED
Mar 12, 12:45 AM (6 years ago)
AFFECTED
Broadband and Ethernet
STARTED
Mar 12, 12:15 AM (6 years ago)
CLOSED
Mar 12, 12:50 AM (6 years ago)
SCOPE
75%
REFERENCE
2501 / AA2501
INFORMATION
  • INITIAL
    6 years ago by Alex

    We noticed (and received reports) that multiple customers were having issues at approximately 00:15 this morning, and investigation work commenced immediately. At present it appears we have a routing problem, affecting traffic to/from some destinations. This is actively being worked on right now. Sincere apologies for the inconvenience this is causing.

  • UPDATE
    6 years ago by Alex

    Improvement : Work on this problem has improved matters. Traces in from external networks appear to now be working in instances where they were not before. Customers who initially reported the problem are now reporting a restoration of routing. At this point in time we do not want to consider this "fixed". But will continue to monitor and work on this until we are able to consider it so.

  • UPDATE
    6 years ago by Andrew

    Technical update : At the moment the cause seems to have been our route servers, getting stuck holding routes from a peer (m.aimless) that didn't actually have routes due to its connection with one carrier (NTT) being down due to routine planned work at their side. Work continues on this. Apologies again.

  • UPDATE
    6 years ago by Andrew

    This problem has been resolved.

  • Closed