Recent posts
Timeline view of events on our network and systems

Events from the AAISP network from the last few months on a scrollable timeline. Mouseover for brief details, click incident to view the full post.

MINOR Closed VoIP and SIMs
AFFECTED
VoIP and SIMs
STARTED
May 27, 06:00 PM (1¼ days ago)
CLOSED
May 27, 07:51 PM (1 day ago)
DESCRIPTION
We're investigating a problem causing intermittent SIP call failures.
Resolution:

MINOR Closed email voip
AFFECTED
email voip
STARTED
May 23, 09:00 AM (5½ days ago)
CLOSED
May 23, 11:35 AM (5½ days ago)
DESCRIPTION
We've had another database problem overnight. Services are working, but changes to some settings (eg Email and VoIP) will be delayed this morning as the database catches up.
Resolution:

MINOR Closed Email
AFFECTED
Email
STARTED
May 20, 05:20 PM (8¼ days ago)
CLOSED
May 21, 01:00 PM (7½ days ago)
DESCRIPTION
We're currently experiencing a database problem that is affecting some services, eg sending/receiving of email. This is being looked in to at the moment.
Resolution:

MINOR Closed VoIP and SIMs
AFFECTED
VoIP and SIMs
STARTED
May 20, 02:00 PM (8¼ days ago)
CLOSED
May 20, 02:00 PM (8¼ days ago)
DESCRIPTION
We experienced a brief call routing outage around 14:00, lasting a few minutes. Services are OK now. We're investigating the cause.
Resolution: This short outage was caused when one of our back-end severs was shut down for maintenance but the automatic fail-over did not work correctly until there was manual intervention. This process should have been seamless. We'll be investigating this further.

MAINTENANCE Open Routers
AFFECTING
Routers
STARTED
May 20, 01:00 AM (9 days ago)
DESCRIPTION
We'll be performing overnight software upgrades on our pool of LNSs and L2TP/BGP routers, starting Tuesday 20th May. One LNS will be done per night, and this involves moving lines between the LNSs and upgrading when lines have been moved off. Customers may see a PPP drop and reconnect in the early hours of the morning this week as this work is carried out.

MINOR Closed CityFibre Glasgow
AFFECTED
CityFibre Glasgow
STARTED
May 13, 10:30 AM (15½ days ago)
CLOSED
May 13, 09:56 PM (15 days ago)
DESCRIPTION
Some of our CityFibre connected services in Glasgow dropped their PPP at 10:31 and since have had around 60% packet loss. We assume a broken fibre within the CityFibre network. We are reporting this to CityFibre
Resolution:

MAINTENANCE Completed L2TP
AFFECTING
L2TP
STARTED
May 02, 06:00 PM (26¼ days ago)
CLOSED
May 07, 08:10 AM (21½ days ago)
DESCRIPTION
We'll be performing some work on our L2TP routers (l2tp.aa.net.uk). Customers may see a couple of drop and reconnect events over the weekend as we move customers between routers and install an additional router.
Resolution: This work has been completed. The new L2TP router will be bought online next week.

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
May 02, 02:50 PM (26¼ days ago)
CLOSED
May 02, 04:21 PM (26¼ days ago)
DESCRIPTION
One of our upstream carriers is reporting intermittent problem with some incoming calls. This will be causing phone calls to some some of our customers not to work. Updates to follow as we get them.
Resolution:

From the carrier: Although we still have further detailed investigations to carry out, we are now confident we have isolated the underlying cause of today’s issues which eventually caused problems to both our inbound and outbound service to various extents plus resulted in some clients being unable to amend routing on numbers.

Our team have checked all systems are operational and will continue to monitor for some time yet. Meanwhile we will be working hard to understand the cause, the impact and the mitigation steps we need to take. This will take a little time and we ask that you bear with us for a couple of days to complete this work but we will ensure you have a full report on Tuesday at the latest.

Our usual monitoring, support and callout processes will remain in place all over the weekend and, due to today’s issues, we will have additional engineers doing manual checks throughout too but we do not anticipate any further disruption.

Please accept our sincerest apologies for the problems our network has caused you and your customers today, we take any outage extremely seriously but we appreciate this one was particularly disruptive for many clients and we assure you that we will be doing our utmost to prevent a similar situation from recurring in the future.


MAINTENANCE Assumed Completed DNS
AFFECTING
DNS
STARTED
Feb 11, 03:30 PM (3½ months ago)
DESCRIPTION

This notification is for customers who run their own authoritative DNS servers and use our secondary-dns.co.uk as secondary (slave).

As part of our DNS infrastructure project we will start to initiate Zone Transfers from an additional set of IP addresses.

You will still send your NOTIFY to secondary-dns.co.uk but you will start to see AXFR requests from an additional set of IP addresses.

Therefore, please update your ACLs to allow the following addresses in addition to what you have at the moment:

  • 194.4.172.3
  • 194.4.172.4
  • 194.4.173.3
  • 194.4.173.4
  • 2001:8b6:1:0:194:4:172:3
  • 2001:8b6:1:0:194:4:172:4
  • 2001:8b6:2:0:194:4:173:3
  • 2001:8b6:2:0:194:4:173:4

Please update your ACLs by March 11th.

We will have an overlap of using the existing DNS servers and the new DNS servers. As part of our testing we will start to use the new IP addresses from February 17th