Last 10 posts, sorted by last updated
Order posts by limited to posts

MAINTENANCE Assumed Completed Routers
AFFECTING
Routers
STARTED
May 20, 01:00 AM (12 days ago)
DESCRIPTION
We'll be performing overnight software upgrades on our pool of LNSs and L2TP/BGP routers, starting Tuesday 20th May. One LNS will be done per night, and this involves moving lines between the LNSs and upgrading when lines have been moved off. Customers may see a PPP drop and reconnect in the early hours of the morning this week as this work is carried out.

MINOR Open Email
AFFECTING
Email
STARTED
Feb 03, 09:00 AM (4 months ago)
DESCRIPTION

Over the past week we have seen a huge number of 'bots' trying to guess customer email credentials in order to try to send email through our outbound email servers: smtp.aa.net.uk.

The attempts were being blocked due to wrong passwords being used, but this caused significant load on our severs due to all the database lookups involved. To address this, we are blocking IP addresses that are listed on the Spamhaus 'Exploits Blocklist (XBL)' and the Spamhaus 'Combined Spam Sources (CSS)' lists. -These are typically IP address known to have hijacked in some way or known spam senders.

This has reduced the load on the email servers significantly, however we are are still blocking around 1.5 million unique IP addresses each day.

We have had a small number of legitimate customers affected by this as their IP address is on these blocklists. (IPs can be looked up on https://check.spamhaus.org). In these cases, please do contact support and we can discuss workarounds.


MAINTENANCE Assumed Completed DNS
AFFECTING
DNS
STARTED
Feb 11, 03:30 PM (3½ months ago)
DESCRIPTION

This notification is for customers who run their own authoritative DNS servers and use our secondary-dns.co.uk as secondary (slave).

As part of our DNS infrastructure project we will start to initiate Zone Transfers from an additional set of IP addresses.

You will still send your NOTIFY to secondary-dns.co.uk but you will start to see AXFR requests from an additional set of IP addresses.

Therefore, please update your ACLs to allow the following addresses in addition to what you have at the moment:

  • 194.4.172.3
  • 194.4.172.4
  • 194.4.173.3
  • 194.4.173.4
  • 2001:8b6:1:0:194:4:172:3
  • 2001:8b6:1:0:194:4:172:4
  • 2001:8b6:2:0:194:4:173:3
  • 2001:8b6:2:0:194:4:173:4

Please update your ACLs by March 11th.

We will have an overlap of using the existing DNS servers and the new DNS servers. As part of our testing we will start to use the new IP addresses from February 17th


MAINTENANCE Assumed Completed authoritative DNS
AFFECTING
authoritative DNS
STARTED
Jun 03, 10:35 AM (12 months ago)
DESCRIPTION

This is only relevant to customers who run their own authoritative DNS servers and use our secondary-dns.co.uk as an additional nameserver.

Overview: We run a "secondary" DNS service for customers where they run the master DNS server and we are secondary slaves. We have a project underway that involves migrating all our authoritative DNS services to a new platform. As part of this we are needing to disable some of the automation we do for adding and updating the customer's master IP address automatically.

The change: From June 17th, If you run your own master DNS server for your domain(s) and secondary-dns.co.uk is a slave, if you change the IP address of your master you will need to contact support@aa.net.uk to request us to update our side.

We have more information about our Authoritative DNS project on our Support Site: https://support.aa.net.uk/New_Authoritive_DNS


MINOR Closed VoIP and SIMs
AFFECTED
VoIP and SIMs
STARTED
May 27, 06:00 PM (4¼ days ago)
CLOSED
May 27, 07:51 PM (4¼ days ago)
DESCRIPTION
We're investigating a problem causing intermittent SIP call failures.
Resolution:

MINOR Closed email voip
AFFECTED
email voip
STARTED
May 23, 09:00 AM (8¾ days ago)
CLOSED
May 23, 11:35 AM (8½ days ago)
DESCRIPTION
We've had another database problem overnight. Services are working, but changes to some settings (eg Email and VoIP) will be delayed this morning as the database catches up.
Resolution:

MINOR Closed Email
AFFECTED
Email
STARTED
May 20, 05:20 PM (11¼ days ago)
CLOSED
May 21, 01:00 PM (10½ days ago)
DESCRIPTION
We're currently experiencing a database problem that is affecting some services, eg sending/receiving of email. This is being looked in to at the moment.
Resolution:

MINOR Closed VoIP and SIMs
AFFECTED
VoIP and SIMs
STARTED
May 20, 02:00 PM (11½ days ago)
CLOSED
May 20, 02:00 PM (11½ days ago)
DESCRIPTION
We experienced a brief call routing outage around 14:00, lasting a few minutes. Services are OK now. We're investigating the cause.
Resolution: This short outage was caused when one of our back-end severs was shut down for maintenance but the automatic fail-over did not work correctly until there was manual intervention. This process should have been seamless. We'll be investigating this further.

MINOR Closed CityFibre Glasgow
AFFECTED
CityFibre Glasgow
STARTED
May 13, 10:30 AM (18½ days ago)
CLOSED
May 13, 09:56 PM (18¼ days ago)
DESCRIPTION
Some of our CityFibre connected services in Glasgow dropped their PPP at 10:31 and since have had around 60% packet loss. We assume a broken fibre within the CityFibre network. We are reporting this to CityFibre
Resolution:

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
May 02, 02:50 PM (29½ days ago)
CLOSED
May 02, 04:21 PM (29¼ days ago)
DESCRIPTION
One of our upstream carriers is reporting intermittent problem with some incoming calls. This will be causing phone calls to some some of our customers not to work. Updates to follow as we get them.
Resolution:

From the carrier: Although we still have further detailed investigations to carry out, we are now confident we have isolated the underlying cause of today’s issues which eventually caused problems to both our inbound and outbound service to various extents plus resulted in some clients being unable to amend routing on numbers.

Our team have checked all systems are operational and will continue to monitor for some time yet. Meanwhile we will be working hard to understand the cause, the impact and the mitigation steps we need to take. This will take a little time and we ask that you bear with us for a couple of days to complete this work but we will ensure you have a full report on Tuesday at the latest.

Our usual monitoring, support and callout processes will remain in place all over the weekend and, due to today’s issues, we will have additional engineers doing manual checks throughout too but we do not anticipate any further disruption.

Please accept our sincerest apologies for the problems our network has caused you and your customers today, we take any outage extremely seriously but we appreciate this one was particularly disruptive for many clients and we assure you that we will be doing our utmost to prevent a similar situation from recurring in the future.