Last 10 minor outages posts, sorted by last updated
Order posts by limited to posts

MINOR Open ZyXEL
AFFECTING
ZyXEL
STARTED
Nov 18, 04:40 PM (30½ days ago)
DESCRIPTION

ZyXEL have published a security advisory which covers some of the ZyXEL routers we have provided our customers, the DX3301 and VMG3927.

New firmware has been released. Customers can either load this manually, or use the 'Upgrade Firmware' button found on the router information page on our Control Pages.

We have received further clarification that the vulnerabilities affect the router's web interface when exposed to the internet. Routers we configure for customers will have the web interface only allowable from our office IP range, and so this vulnerability is deemed low risk. We still recommend that customers upgrade. The upgrade process will take a few minutes but it does not reset the configuration.

We will make direct contact with customers with these routers, and support staff will mention this if and when they are talking to customers and notice the firmware is out of date.


MINOR Open Email
AFFECTING
Email
STARTED
Feb 03, 09:00 AM (10½ months ago)
DESCRIPTION

Over the past week we have seen a huge number of 'bots' trying to guess customer email credentials in order to try to send email through our outbound email servers: smtp.aa.net.uk.

The attempts were being blocked due to wrong passwords being used, but this caused significant load on our severs due to all the database lookups involved. To address this, we are blocking IP addresses that are listed on the Spamhaus 'Exploits Blocklist (XBL)' and the Spamhaus 'Combined Spam Sources (CSS)' lists. -These are typically IP address known to have hijacked in some way or known spam senders.

This has reduced the load on the email servers significantly, however we are are still blocking around 1.5 million unique IP addresses each day.

We have had a small number of legitimate customers affected by this as their IP address is on these blocklists. (IPs can be looked up on https://check.spamhaus.org). In these cases, please do contact support and we can discuss workarounds.


MINOR Closed BT
AFFECTED
BT
STARTED
Dec 16, 05:30 PM (2½ days ago)
CLOSED
Dec 18, 09:28 AM (20¼ hours ago)
DESCRIPTION
We're investigating a drop of BT services.
Resolution: The link will remain out of service until BT confirm they have fixed their end, which is likely to be in the new year. Services are working without problem on our remaining links.

MINOR Closed seconedary-dns
AFFECTED
seconedary-dns
STARTED
Dec 11, 09:45 AM (7¾ days ago)
CLOSED
Dec 12, 03:52 PM (6½ days ago)
DESCRIPTION
Our secondary DNS server - secondary-dns.co.uk is timing out on some queries. This is being investigated.
Resolution: Having adjusted some thresholds on our backend DNS servers and after monitoring closely over the past 24 hours, we've not had any further problems.

MINOR Closed Routing to BT
AFFECTED
Routing to BT
STARTED
Nov 28, 10:30 AM (20¾ days ago)
CLOSED
Nov 28, 10:45 AM (20¾ days ago)
DESCRIPTION
We're seeing odd routing problems and packetloss between us and BTs network - eg to IP addresses that BT host for their servers or broadband services, not our links to BT for our broadband services. We are investigating.
Resolution: This seems like the problem was at BTs end, we've heard from other ISPs who had similar routing issues to/from BT's network.

MINOR Closed AWS
AFFECTED
AWS
STARTED
Oct 23, 09:45 AM (1¾ months ago)
CLOSED
Nov 20, 10:13 AM (28¾ days ago)
DESCRIPTION
We've had reports of customers having problems routing to some IPs within Amazon
Resolution: Separate to the routing problem, both of our Amazon interconnects are being migrated to different equipment at Amazon's end. They are out of action for the moment. We still have peering to Amazon over LINX.

MINOR Closed BT
AFFECTED
BT
STARTED
Nov 18, 11:00 PM (30¼ days ago)
CLOSED
Nov 18, 11:50 PM (30 days ago)
DESCRIPTION
There were several 'blips' overnight that affected some BT customers between 11PM and midnight. Service has been stable since, we are investigating the cause
Resolution: This was caused by BT planned work, which went wrong. They are planning work on the other pair of fibres on this hostink during the early hours of Thursday 20th November, but we will take this out of service beforehand.

MINOR Closed BT
AFFECTED
BT
STARTED
Nov 16, 10:20 AM (1 month ago)
CLOSED
Nov 16, 03:45 PM (1 month ago)
DESCRIPTION
At 10:20 a number of BT lines dropped, we're investigating.
Resolution: At 10:20 about 30% of customers dropped there connection and reconnected within a few minutes. Service was back to normal by 10:28. One of our 4 links to BT had loss of light. BT replaced a faulty LIM (Line Interface Module) card at Greenwich later in the afternoon.

MINOR Closed BT
AFFECTED
BT
STARTED
Nov 11, 07:55 PM (1¼ months ago)
CLOSED
Nov 12, 07:15 AM (1 month ago)
DESCRIPTION
at around 19:56 a fairly large number of BT circuits dropped. We're investigating.
Resolution: Around a quarter of our customers on BT had a short service interruption caused by a faulty card within BTs network that caused loss of light on one of our interconnects to BT. These customers reconnected within a couple of minutes. The fault was caused by a faulty card at BTs end. The card was swapped overnight, and we bought the interconnect back in to service at 7:15AM.

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Oct 15, 11:00 AM (2 months ago)
CLOSED
Oct 17, 05:00 PM (2 months ago)
DESCRIPTION
Some customers have been experiencing irregular phone call behaviour - such as when incoming calls are set to ring multiple phones, some phones carry on ringing after the call has been successfully answered elsewhere.
Resolution: Some call and registration failures have been the result of slow back-end systems. We have made various optimisations and code changes which have been working well throughout the day (Friday). We also have avenues for further improvements which we be implemented in the near future. We do apologise to those who had calls disrupted due to this.