We're investigating a problem with some broadband lines showing 50% packetloss from just after 11PM.
This is affecting about 50% of TalkTalk connected lines... still investigating.
This is affecting fewer than 50% of lines, as first thought. It is specific to a particular TalkTalk LTS, but is not affecting all lines on that LTS. This has been reported to TalkTalk.
Whilst TalkTalk investigate, we'll look to remove traffic from these LTS....
Further, this is not affecting all lines, it seems to be mostly lines that have PPP reconnected since 11PM on Wednesday evening.
We've moved TalkTalk traffic away from HEX, but this has not helped with the packet loss - the traffic still gets routed in TalkTalk's network through the same route that is causing this problem.
We've spoken to talktalk and they are investigating
TalkTalk are raising an internal 'incident' so as to investigate this problem further. They have also had a similar report from another ISP, so this does seem to be a wider issue within TalkTalk.
TalkTalk's incident is here: https://aastatus.net/33308
TalkTalk have done something, as the packetloss has stopped... Lines are looking OK.
The problem was resolved just after 9AM. the reason for this outage is in https://aastatus.net/33308 "Networks have investigated and advised they found a number of errors on a card in LOH which was erroring and causing back plain errors."