Last 10 posts, sorted by last updated
Order posts by limited to posts

MAINTENANCE Assumed Completed IRC
AFFECTING
IRC
STARTED
Oct 26, 10:00 AM (4¼ days ago)
DESCRIPTION
[minor] We run a pool of three IRC servers, and usually have two live at any one time. One of these IRC servers is being rebooted on Sunday midday as part maintenance at the hosting provider - it's not in DNS at the moment but IRC clients will still be connected to it and may well drop and reconnect on Sunday.

MINOR Open AWS
AFFECTING
AWS
STARTED
Oct 23, 09:45 AM (7½ days ago)
DESCRIPTION
We've had reports of customers having problems routing to some IPs within Amazon

MINOR Open Email
AFFECTING
Email
STARTED
Feb 03, 09:00 AM (8¾ months ago)
DESCRIPTION

Over the past week we have seen a huge number of 'bots' trying to guess customer email credentials in order to try to send email through our outbound email servers: smtp.aa.net.uk.

The attempts were being blocked due to wrong passwords being used, but this caused significant load on our severs due to all the database lookups involved. To address this, we are blocking IP addresses that are listed on the Spamhaus 'Exploits Blocklist (XBL)' and the Spamhaus 'Combined Spam Sources (CSS)' lists. -These are typically IP address known to have hijacked in some way or known spam senders.

This has reduced the load on the email servers significantly, however we are are still blocking around 1.5 million unique IP addresses each day.

We have had a small number of legitimate customers affected by this as their IP address is on these blocklists. (IPs can be looked up on https://check.spamhaus.org). In these cases, please do contact support and we can discuss workarounds.


MAINTENANCE Assumed Completed DNS
AFFECTING
DNS
STARTED
Feb 11, 03:30 PM (8½ months ago)
DESCRIPTION

This notification is for customers who run their own authoritative DNS servers and use our secondary-dns.co.uk as secondary (slave).

As part of our DNS infrastructure project we will start to initiate Zone Transfers from an additional set of IP addresses.

You will still send your NOTIFY to secondary-dns.co.uk but you will start to see AXFR requests from an additional set of IP addresses.

Therefore, please update your ACLs to allow the following addresses in addition to what you have at the moment:

  • 194.4.172.3
  • 194.4.172.4
  • 194.4.173.3
  • 194.4.173.4
  • 2001:8b6:1:0:194:4:172:3
  • 2001:8b6:1:0:194:4:172:4
  • 2001:8b6:2:0:194:4:173:3
  • 2001:8b6:2:0:194:4:173:4

Please update your ACLs by March 11th.

We will have an overlap of using the existing DNS servers and the new DNS servers. As part of our testing we will start to use the new IP addresses from February 17th


MAJOR Closed CityFibre
AFFECTED
CityFibre
STARTED
Oct 22, 09:55 PM (8 days ago)
CLOSED
Oct 22, 10:22 PM (7¾ days ago)
DESCRIPTION
We are investigating a problem with our CityFibre services.
Resolution: We do apologise for this outage. We are looking into making our interconnect to CityFibre more resilient.

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Oct 15, 11:00 AM (15¼ days ago)
CLOSED
Oct 17, 05:00 PM (13 days ago)
DESCRIPTION
Some customers have been experiencing irregular phone call behaviour - such as when incoming calls are set to ring multiple phones, some phones carry on ringing after the call has been successfully answered elsewhere.
Resolution: Some call and registration failures have been the result of slow back-end systems. We have made various optimisations and code changes which have been working well throughout the day (Friday). We also have avenues for further improvements which we be implemented in the near future. We do apologise to those who had calls disrupted due to this.

MAINTENANCE Completed Network
AFFECTING
Network
STARTED
Oct 09, 01:00 AM (21¾ days ago)
CLOSED
Oct 22, 09:02 AM (8½ days ago)
DESCRIPTION

We'll be performing routine overnight software upgrades on our pool of LNSs and BGP routers, starting Thursday 9th October. One LNS will be done per night, and this involves moving lines between the LNSs and upgrading when lines have been moved off. Customers may see a PPP drop and reconnect in the early hours of the morning as this work is carried out.

Upgrades to our BGP routers will also happen overnight but should have little to no impact. Resolution: This work has been completed.


MINOR Closed BT
AFFECTED
BT
STARTED
Oct 03, 05:30 AM (27½ days ago)
CLOSED
Oct 03, 05:35 AM (27½ days ago)
DESCRIPTION

Between 5AM and 5:30AM we saw a reasonable number of BT SoGEA lines drop for around 100 seconds and reconnect.

They only dropped off once, but over a period of around 30 minutes we saw a few hundred drop and reconnect. As far as we can see the only common factor is that they are BT SoGEA lines. We don't have any planned work notifications for work on this scale, and the sites are dotted around the country.


Resolution: These lines were migrated from VDSL to SoGEA two days ago and we suspect this could be a normal, automatic, DLM resync event.

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Sep 29, 10:20 AM (1 month ago)
CLOSED
Sep 29, 10:50 AM (1 month ago)
DESCRIPTION
We're investigating reports of intermittent VoIP call and registration problems.
Resolution: The problem lasted a few minutes, we're making arrangements to increase the performance of our systems to help in future similar circumstances.

MAINTENANCE Completed VoIP
AFFECTING
VoIP
STARTED
Sep 24, 05:30 AM (1 month ago)
CLOSED
Sep 24, 05:35 AM (1 month ago)
DESCRIPTION
We will be performing maintenance on parts of our VoIP back-end systems. This work is planned to start from 5:30AM and last a couple of minutes. Phone registrations and call attempts during this time may fail.
Resolution: This work has been completed.