Last 10 posts, sorted by last updated
Limit to posts

MAINTENANCE Assumed Completed Router Upgrades
AFFECTING
Router Upgrades
STARTED
Nov 15, 04:00 AM (12 days ago)
DESCRIPTION
We are starting to roll out new software to the (non-LNS) FireBrick routers on our network. These will happen overnight this week, starting on 15th November. There should be no impact on customer services.

MAINTENANCE Open Broadband
AFFECTING
Broadband
STARTED
Nov 15, 01:00 AM (12 days ago)
DESCRIPTION
We are performing overnight software upgrades on our "Gormless" set of LNSs. This will cause customer lines to drop and reconnect when the LNS they are on is updated. We will be doing one LNS a night and the work starts from 1AM. Due to the number of LNSs this will last a few weeks. More information about LNS switchovers, and to control the time your line is forced to reconnect, please see: https://support.aa.net.uk/LNS_Switches

MINOR Closed TalkTalk
AFFECTED
TalkTalk
STARTED
Sep 30, 01:30 PM (1¾ months ago)
CLOSED
Nov 25, 09:34 AM (1¾ days ago)
DESCRIPTION

We do apologise for the inconvenience these drops are having on our customers, this is still an ongoing problem.

The drops can be seen as long vertical lines on our blip graph: https://aastatus.net/#blip

There have been a number of problems affecting TalkTalk ADSL and VDSL circuits this week. They have been a mix of overnight planned work, overnight planned work going wrong and causing disruption in the mornings and drops during the day.

These are less of a problem where customers have bonded lines with services from different back-haul providers (TalkTalk and BT) but they are disruptive to single-line customers.

Earlier in the week we took our Telehouse interconnect out of service as it was connected to equipment at TalkTalk that was having serious problems. However, we have still seen a few drops during the day. These drops are not affecting all circuits but also don't seem to be localised to particular areas of the country.

TalkTalk say they have no more work to do on the Telehouse side and so over this weekend we will bring back the downed interconnect which will restore resilience. This should not cause a blip, but will be done out of hours.

We are still in dialogue with TalkTalk about the unexplained drops and will report here the findings and outcome.
Resolution:

MAJOR Closed General
AFFECTED
General
STARTED
Nov 21, 07:25 PM (5¼ days ago)
CLOSED
Nov 21, 07:45 PM (5¼ days ago)
DESCRIPTION
We're investigating a network incident that occured at around 19:30, updates to follow.
Resolution: Service restored and back to normal at around 19:50. This was due to a network issue that affected some of our BGP sessions which caused routing problems to certain destinations.

MINOR Closed SIP2SIM
AFFECTED
SIP2SIM
STARTED
Nov 15, 12:54 PM (11½ days ago)
CLOSED
Nov 16, 11:36 AM (10½ days ago)
DESCRIPTION
O2UK have advised that their monitoring platforms are reporting Voice, Data and SMS failures. O2UK are currently investigating.
Resolution: From our carrier: O2UK have confirmed that service was restored at 10:45am 15th November. Minimal impact would have been experienced due to service being maintained by another technology.

MINOR Closed BT Drops
AFFECTED
BT Drops
STARTED
Nov 14, 12:00 AM (13 days ago)
CLOSED
Nov 14, 12:25 AM (13 days ago)
DESCRIPTION
From around midnight through to 00:30 we saw a number of BT circuits drop and reconnect. We saw traffic decrease on one of our four links to BT, so this looks like a routing or device problem within BT. We're investigating further
Resolution: Service was back to normal by 00:25. Neither us or BT were unable to find a cause for the loss of link, we will monitor the link for further problems.

MAINTENANCE Completed Broadband
AFFECTING
Broadband
STARTED
Nov 10, 01:00 AM (17 days ago)
CLOSED
Nov 10, 07:00 AM (16¾ days ago)
DESCRIPTION
Due to a recent crash on one of our LNSs (G.Gormless) we are going to to move lines off this LNS. This will happen in the early hours of Thursday 10th November, from 1AM. A small number of customers will see their line drop and then reconnect.
Resolution: Completed.

MINOR Closed Broadband
AFFECTED
Broadband
STARTED
Nov 09, 03:04 PM (17½ days ago)
CLOSED
Nov 09, 03:08 PM (17½ days ago)
DESCRIPTION
A small number of lines on our 'G.Gormless' LNS reconnected. This is due to the router crashing. The cause is being investigated.
Resolution:

MAINTENANCE Completed At risk
AFFECTING
At risk
STARTED
Nov 05, 03:00 AM (22 days ago)
CLOSED
Nov 05, 03:25 AM (22 days ago)
DESCRIPTION
We will be performing a small change to some of our core network switches overnight. Whilst the risk of this causing a problem is very small we are posting this just in case. As a further precaution, we will be moving BT DSL traffic away from the network devices we are making this configuration change on.
Resolution:

MINOR Closed BT DSL
AFFECTED
BT DSL
STARTED
Oct 26, 01:30 AM (1 month ago)
CLOSED
Oct 26, 06:34 AM (1 month ago)
DESCRIPTION
Similar to https://aastatus.net/42480 - BT circuits were affected again overnight due to one of our interconnects to BT dropping. The affected BT circuits dropped and reconnected at around 01:30. When this happens not all lines reconnect to their normal LNS router at our side, and instead connect to the 'backup' LNS - this backup one had too many lines on it so these lines saw a second reconnect at around 6:25 as we forced them to cleanly reconnect properly. We are still investigating the problem with the interlink with BT.
Resolution: The overnight drop affecting BT circuits was BT emergency work whereby equipment was replaced within their network as a result of the problems earlier in the day https://aastatus.net/42480 This would have affected other ISPs who interconnect with BT in Equinix LD8 in a similar way to ourselves.