Last 10 posts, sorted by last updated
Order posts by limited to posts

MAINTENANCE Planned Email
AFFECTING
Email
STARTING
Dec 03, 09:00 AM (4½ days )
DESCRIPTION
We will be doing some non-service affecting work on our email (POP3 and IMAP) servers. The work involves reconfiguring how our backend mail stores synchronise mailboxes between each other. We do not anticipate this to be service affecting hence doing this work during the day.

MAINTENANCE Assumed Completed Amazon
AFFECTING
Amazon
STARTING
Dec 02, 09:30 AM (3½ days )
DESCRIPTION
We are in a position where we are now able to re-enable one of our interconnects to Amazon/AWS. This will move most Amazon traffic away from our peering with them over LINX to the direct interconnect we have. This is planned for Tuesday morning at around 10AM. (This was scheduled for Friday 28th, but as it was Black Friday, we've moved to Tuesday)

MINOR Open ZyXEL
AFFECTING
ZyXEL
STARTED
Nov 18, 04:40 PM (9¾ days ago)
DESCRIPTION

ZyXEL have published a security advisory which covers some of the ZyXEL routers we have provided our customers, the DX3301 and VMG3927.

New firmware has been released. Customers can either load this manually, or use the 'Upgrade Firmware' button found on the router information page on our Control Pages.

We have received further clarification that the vulnerabilities affect the router's web interface when exposed to the internet. Routers we configure for customers will have the web interface only allowable from our office IP range, and so this vulnerability is deemed low risk. We still recommend that customers upgrade. The upgrade process will take a few minutes but it does not reset the configuration.

We will make direct contact with customers with these routers, and support staff will mention this if and when they are talking to customers and notice the firmware is out of date.


MINOR Open Email
AFFECTING
Email
STARTED
Feb 03, 09:00 AM (9¾ months ago)
DESCRIPTION

Over the past week we have seen a huge number of 'bots' trying to guess customer email credentials in order to try to send email through our outbound email servers: smtp.aa.net.uk.

The attempts were being blocked due to wrong passwords being used, but this caused significant load on our severs due to all the database lookups involved. To address this, we are blocking IP addresses that are listed on the Spamhaus 'Exploits Blocklist (XBL)' and the Spamhaus 'Combined Spam Sources (CSS)' lists. -These are typically IP address known to have hijacked in some way or known spam senders.

This has reduced the load on the email servers significantly, however we are are still blocking around 1.5 million unique IP addresses each day.

We have had a small number of legitimate customers affected by this as their IP address is on these blocklists. (IPs can be looked up on https://check.spamhaus.org). In these cases, please do contact support and we can discuss workarounds.


MINOR Closed Routing to BT
AFFECTED
Routing to BT
STARTED
Nov 28, 10:30 AM (5½ hours ago)
CLOSED
Nov 28, 10:45 AM (5¼ hours ago)
DESCRIPTION
We're seeing odd routing problems and packetloss between us and BTs network - eg to IP addresses that BT host for their servers or broadband services, not our links to BT for our broadband services. We are investigating.
Resolution: This seems like the problem was at BTs end, we've heard from other ISPs who had similar routing issues to/from BT's network.

MAINTENANCE Completed L2TP
AFFECTING
L2TP
STARTED
Nov 24, 03:15 AM (4½ days ago)
CLOSED
Nov 24, 03:30 AM (4½ days ago)
DESCRIPTION
On Monday 24th November, at 3:15AM we will be upgrading the software on one of our L2TP servers (l2tp.aa.net.uk) This will cause some L2TP customers to drop and reconnect twice as this happens. (Twice, as whilst the router is upgraded connections will reconnect to the other L2TP server, and then will moved back once the upgrade has completed.)
Resolution: The upgrade completed successfully.

MINOR Closed AWS
AFFECTED
AWS
STARTED
Oct 23, 09:45 AM (1 month ago)
CLOSED
Nov 20, 10:13 AM (8¼ days ago)
DESCRIPTION
We've had reports of customers having problems routing to some IPs within Amazon
Resolution: Separate to the routing problem, both of our Amazon interconnects are being migrated to different equipment at Amazon's end. They are out of action for the moment. We still have peering to Amazon over LINX.

MINOR Closed BT
AFFECTED
BT
STARTED
Nov 18, 11:00 PM (9½ days ago)
CLOSED
Nov 18, 11:50 PM (9½ days ago)
DESCRIPTION
There were several 'blips' overnight that affected some BT customers between 11PM and midnight. Service has been stable since, we are investigating the cause
Resolution: This was caused by BT planned work, which went wrong. They are planning work on the other pair of fibres on this hostink during the early hours of Thursday 20th November, but we will take this out of service beforehand.

MAINTENANCE Completed BT
AFFECTING
BT
STARTED
Nov 19, 09:00 PM (8¾ days ago)
CLOSED
Nov 20, 07:05 AM (8¼ days ago)
DESCRIPTION
BT have planned work on one of the fibre pairs on one of our hostlinks. We will take this link out of service to avoid disruption to customers.
Resolution: The disruption between 02:29 and 02:37 was caused by BT's Planned work. However, a communications error on our side meant we shut down the wrong link to BT. We do apologise for this! We do not expect any further drops though.

MINOR Closed BT
AFFECTED
BT
STARTED
Nov 16, 10:20 AM (12 days ago)
CLOSED
Nov 16, 03:45 PM (12 days ago)
DESCRIPTION
At 10:20 a number of BT lines dropped, we're investigating.
Resolution: At 10:20 about 30% of customers dropped there connection and reconnected within a few minutes. Service was back to normal by 10:28. One of our 4 links to BT had loss of light. BT replaced a faulty LIM (Line Interface Module) card at Greenwich later in the afternoon.