Latency and Packet Loss on Some TalkTalk Lines
MINOR Closed TalkTalk
STATUS
Closed
CREATED
Jan 09, 10:13 AM (28¼ days ago)
AFFECTED
TalkTalk
STARTED
Jan 09, 09:00 AM (28¼ days ago)
CLOSED
Jan 09, 01:00 PM (28¼ days ago)
REFERENCE
42499 / AA42499
INFORMATION
  • INITIAL
    28¼ days ago by Andrew

    Since 9AM today we are seeing latency and packet loss on a number of TalkTalk circuits. The common factor seems to be a particular route the traffic takes within TalkTalk's network - this indicates congestion caused by a broken fibre or a faulty device within TalkTalk.

  • UPDATE
    28¼ days ago by Andrew

    This has been raised with TalkTalk.

  • UPDATE
    28¼ days ago by Andrew

    Separately to this congestion problem, TalkTalk do have planned work on the early morning of Wednesday to reboot one of their core routers. We don't think this congestion and the router reboot work are connected but we will bring forward our own planned work to divert traffic away from this router. - this will mean that we will be taking down our link to TalkTalk in Telehouse this morning (Monday 9th) as per https://aastatus.net/42495

  • UPDATE
    28¼ days ago by Andrew

    Traffic has been moved, but this has not made a difference to the loss/latency that we are seeing on some lines. Updates to follow.

  • UPDATE
    28¼ days ago by Andrew

    On the affected lines we are seeing the packet loss and latency slowly reduce but the problem has not gone away or been fixed. Customers may try rebooting their router (or doing a PPP restarts), this may cause the line to be routed within TalkTalks network differently and not suffer this problem. At the moment we are still waiting to hear from TalkTalks team regarding their investigations.

  • UPDATE
    28¼ days ago by Andrew

    Latest from TalkTalk is: "Fault Description: We have identified an issue which will be causing intermittent degradation in data services for customers who are routing through Telehouse West. Customers will be experiencing intermittent packet loss and other potential QoS issues. We are currently working to identify the root cause and implement the appropriate resolution."

  • UPDATE
    28 days ago by Andrew

    Since around 1PM we have seen lines looking better. TalkTalk say: "Service has now been restored. We are completing final checks and any related incidents have been passed back for re-test. Resolution details to follow."

  • RESOLUTION
    28¼ days ago by Andrew

    From TalkTalk: "Resolution Details: Due to an ongoing Transmission issue we are having within our core network we have lost multiple 100G and 10G links , causing our core network to run at reduced capacity. During this period, we noticed an interlink between our edge routers was congesting causing issues for customers. We have moved traffic away from this interlink to restore service to normal operations. Technical / Suspected Root Cause: Traffic congestion in edge network. Traffic moved away to alleviate congestion."

  • Closed