TalkTalk line drops and packet loss
MINOR Closed Broadband
STATUS
Closed
CREATED
Jul 01, 12:30 PM (9¾ months ago)
AFFECTED
Broadband
STARTED
Jul 01, 12:29 PM (9¾ months ago)
CLOSED
Jul 01, 07:10 PM (9¾ months ago)
REFERENCE
42546 / AA42546
MASTODON
INFORMATION
  • INITIAL
    9¾ months ago by James

    We're aware of a problem affecting some TalkTalk based lines. We are investigating with TalkTalk.

  • UPDATE
    9¾ months ago by James

    TT have said they'll provide further information shortly.

  • UPDATE
    9¾ months ago by James

    Line drops seem fixed - we're monitoring.

  • UPDATE
    9¾ months ago by James

    It was linked to a known issue "Multiple Regions - Loss of Data Service"

  • UPDATE
    9¾ months ago by James

    TT believe this has been fixed by shutting down a faulty link within their network. Our affected customer lines look clean.

  • UPDATE
    9¾ months ago by James

    Some lines are still seeing packet loss. TT are investigating.

  • UPDATE
    9¾ months ago by Andrew

    We are still seeing ~20% packet loss on some TalkTalk lines - We are also seeing errors on our link to TalkTalk in our Telehouse datacentre. We are taking measures to move traffic over to our link to TalkTalk in Euinix LD8 (A different datacentre in London).

  • UPDATE
    9¾ months ago by Andrew

    We've given TalkTalk a list of example lines with problems (and lines that had packet loss which has since gone away after end user router reboot) TalkTalk are still aware of an ongoing issue, and have had similar reports from other Service Providers too - today's problems have affected other ISPs too.

  • UPDATE
    9¾ months ago by Andrew

    Brief Summary of today's problems so far:

    1. TalkTalk had a core network problem between noon and 1PM that caused many of or TalkTalk lines to drop and reconnect during this time
    2. We made contact with TalkTalk, and they confirmed the problem and shut down a core link as they suspected a faulty card in a router
    3. Since then, we've see a much smaller number of lines having around 20% packet loss - this will make using the internet pretty unusable.
    4. This was reported to TalkTalk, and they have confirmed that they are still investigating
    5. We moved TalkTalk FTTC traffic off our Telehouse link and over to our Equinix link to see if that would make the packet loss go away, but it hasn't.
    Customers who think they are affected by the packetloss could reboot their router a couple of times and try using the internet after each try - this seems to have helped for some customers, as the routing of the line within TalkTalk's network may differ when it reconnects - though it may take a few attempts.

  • UPDATE
    9¾ months ago by Andrew

    We are still working with TalkTalk to identify the cause of packet loss affecting some lines. We have just moved ADSL traffic over to Telehouse - and the loss us unchanged. So it seems the loss is not directly related to our links to TalkTalk.

  • UPDATE
    9¾ months ago by Andrew

    At 19:08 this evening we saw a large number of TalkTalk circuits drop and reconnect. We're not sure what caused this, but are awaiting an update from TalkTalk.

  • RESOLUTION
    9¾ months ago by James

    Since the reconnects at 19:09, the packetloss problem has gone away, TalkTalk lines look to be working as normal. Interestingly, a few lines actually started to show small amounts of packet loss on Thursday at 2:20AM, which gradually increased. We'll post more information about the case as and when we get it from TalkTalk.

    TalkTalk's conclusion is: We have moved traffic from a faulty card, the card has been shut down, this has resolved the issue.

  • Closed