Blip for a large number of BT lines
MAJOR Closed BT
STATUS
Closed
CREATED
Jan 08, 11:48 PM (1¾ months ago)
AFFECTED
BT
STARTED
Jan 08, 11:40 PM (1¾ months ago)
CLOSED
Jan 09, 12:29 AM (1¾ months ago)
REFERENCE
42597 / AA42597
MASTODON
INFORMATION
  • INITIAL
    1¾ months ago by Andrew

    The Drop and reconnect of a large number of BT circuits was due to planned work: https://aastatus.net/42596

  • UPDATE
    1¾ months ago by Andrew

    Lines are reconnecting, most are back online now.

  • UPDATE
    1¾ months ago by Andrew

    We have four links to BT. Two in each of our London Datacentres. BT have overnight work that will take one pair of these links out of service and would be disruptive. Usually we are able to cleanly shut down these links to drain traffic off them. Tonight, we shut down one of the links without a problem, but shutting down the second did cause a large number of BT circuits to drops and reconnect. This was not the intent, and we've been able to move traffic like this successfully in the past. We do apologise to those who had their service interrupted this evening.

  • UPDATE
    1¾ months ago by Andrew

    Lines should be back, many but not all are - we are investigating.

  • UPDATE
    1¾ months ago by Andrew

    We restored one of the links we shutdown and this restored service for those who were still offline. This does mean, that when BT do their work a bit later, that there is a risk of another blip or possible outage.

  • RESOLUTION
    1¾ months ago by Andrew

    Affected lines are back online. This post will be closed now - but refer back to the parent post for further updates of BTs work on 9th January in the early hours of the morning: https://aastatus.net/42596. The cause of this drop has been identified as a mis-configuration within BTs network which prevented our traffic from failing over to our links to BT in Telehouse. This has been fixed by BT and we will retest.

  • Closed