Last 10 minor outages posts, sorted by last updated
Order posts by limited to posts

MINOR Closed General Internet Access
AFFECTED
General Internet Access
STARTED
Feb 11, 09:15 AM (16½ days ago)
CLOSED
Feb 11, 11:30 AM (16½ days ago)
DESCRIPTION

We have 5 routers for transit and we are seeing low levels of packet loss on one of these routers.

The cause of this is excess traffic due to our direct interconnect with Amazon being down and Amazon traffic being sent over our transit connections instead of the interconnect.

We have contacted Amazon and hope to have the interconnect working again soon, but we're not yet sure why they have taken it down.


Resolution:

This problem was caused by our interconnect to Amazon going down due to maintenance at the Amazon side. Amazon have a policy not to route traffic over exchange points such as LINX and LONAP (where we have a lot of excess capacity) but instead would send traffic over our transit links (which have less excess capacity).

To prevent this from happening again: We are already in the process of increasing our transit capacity anyway, and we will investigate having a second interconnect in to Amazon.

Further update: a second interconnect to Amazon is underway.


MINOR Closed VoIP and SIMs
AFFECTED
VoIP and SIMs
STARTED
Jan 14, 02:05 PM (1¼ months ago)
CLOSED
Jan 14, 02:59 PM (1¼ months ago)
DESCRIPTION
We have an internal hardware failure, which in itself shouldn't be problematic for services, which unfortunately has highlighted a problem with the resilience of the SMS platform and in some circumstances SMS won't send. We're working to get this back up and running ASAP. We also will of course review how it could be possible for this to happen.
Resolution:

MINOR Closed Broadband
AFFECTED
Broadband
STARTED
Jan 12, 11:55 AM (1½ months ago)
CLOSED
Jan 12, 12:12 PM (1½ months ago)
DESCRIPTION
We're seeing a small/moderate amount of lines drop at about 11:55 - they are TalkTalk connected and in the south/east of England area. as of 12:03 they have not reconnected.
Resolution:

Lines reconnected by 12:10. We suspect a fault somewhere in TalkTalk's network, we'll post an update when we hear back from them.

TalkTalk say: We have some transmission issues around Hove, its being investigated.

Further info from TalkTalk: Multiple Core links flapped circuits have recovered and being monitored.


MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Dec 08, 09:00 AM (2½ months ago)
CLOSED
Dec 10, 09:00 AM (2½ months ago)
DESCRIPTION
Some incoming calls are having the CLI incorrectly set to the number called instead of the number calling. This means that some customers are seeing calls coming in that show their own phone number instead of that of the caller.
Resolution:

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Nov 30, 12:32 AM (3 months ago)
CLOSED
Nov 30, 03:06 AM (2¾ months ago)
DESCRIPTION
We have two VoIP servers, A.Voiceless and B.Voiceless. Currently B.Voiceless is offline and A.Voiceless has been set to take all traffic whilst we investigate the problem.
Resolution:

MINOR Closed Website
AFFECTED
Website
STARTED
Nov 17, 12:18 PM (3¼ months ago)
CLOSED
Nov 25, 11:40 AM (3 months ago)
DESCRIPTION
The VoIP rate card is giving errors, this is being investigated.
Resolution: These pages are working again now!

MINOR Closed Connectivity
AFFECTED
Connectivity
STARTED
Nov 13, 09:00 AM (3½ months ago)
CLOSED
Nov 13, 08:00 PM (3½ months ago)
DESCRIPTION

We've had some problems today with Apple related traffic causing some of our routers to get busy. This has affected some customers with some latency and packetloss to some destinations on the Internet. The problem is that the recent software updates from Apple are being downloaded via our 'transit' links instead of our 'peering' links.

The bulk of our traffic comes to us over our peering links where we have higher capacity connections in to exchange points such as LINX and LONAP. However, even though we have direct peering with Apple of these higher capacity links, today's Apple traffic is being set over our smaller transit links.

We have tried to balance the traffic across the transit links we have, but this hasn't been perfect. We've emailed Apple, requesting that they send traffic to us over the peering links but we've only had an automatic ticket confirmation reply so far.


Resolution:

Traffic levels Friday evening were the highest we've ever seen, however the traffic was spread over multiple routers and were at levels that didn't impact our service negatively. We've had no word back from Apple about them using our peering links. We'll be looking at upgrading our transit capacity as a result of this so as to be able to cope better in the future.

We also understand that there was various reports in the media about Apple having problems yesterday and there were widely reported problems with update downloads failing. We're not sure is this is related to the reasons why Apple traffic was being set via transit instead of our direct peering with Apple though.

2020-11-18 Further update: We're in positive discussions with Apple in regard to improving the connectivity between our networks.


MINOR Closed DNS
AFFECTED
DNS
STARTED
Nov 17, 12:30 PM (3¼ months ago)
CLOSED
Nov 17, 03:00 PM (3¼ months ago)
DESCRIPTION
We've identified a fault in our DNS updates for domains that we host. For the moment, any changes to DNS records made on the Control Pages will not be made live whilst we investigate this.
Resolution:

MINOR Closed Domains - email
AFFECTED
Domains - email
STARTED
Nov 17, 11:30 AM (3¼ months ago)
CLOSED
Nov 17, 01:15 PM (3¼ months ago)
DESCRIPTION
Email to the company are currently sending bounce messages - we are investigating this.
Resolution: Email is now ok. This problem is in relation to https://aastatus.net/38227

MINOR Closed Broadband
AFFECTED
Broadband
STARTED
Nov 11, 02:45 PM (3½ months ago)
CLOSED
Nov 11, 03:08 PM (3½ months ago)
DESCRIPTION
We're investigating broadband drops
Resolution: The fault lasted from 14:45 through to 15:08 and was affecting some BT circuits that were on 6 of our 20 LNSs (the routers at our side that broadband lines connect to). Of those affected some had a short blip and others had a high amount of packetloss. The cause of the drops and loss was loss of connectivity to some parts of BTs network. However, this is likely a problem our side rather than at BT. The affected LNSs are on the same set of network switches. We've not yet identified the root cause, but our investigations will continue, and we'll be planning some out of hours work in relation to this.