Last 10 minor outages posts, sorted by last updated
Order posts by limited to posts

MINOR Open Email
AFFECTING
Email
STARTED
Feb 03, 09:00 AM (7¼ days ago)
DESCRIPTION

Over the past week we have seen a huge number of 'bots' trying to guess customer email credentials in order to try to send email through our outbound email servers: smtp.aa.net.uk.

The attempts were being blocked due to wrong passwords being used, but this caused significant load on our severs due to all the database lookups involved. To address this, we are blocking IP addresses that are listed on the Spamhaus 'Exploits Blocklist (XBL)' and the Spamhaus 'Combined Spam Sources (CSS)' lists. -These are typically IP address known to have hijacked in some way or known spam senders.

This has reduced the load on the email servers significantly, however we are are still blocking around 1.5 million unique IP addresses each day.

We have had a small number of legitimate customers affected by this as their IP address is on these blocklists. (IPs can be looked up on https://check.spamhaus.org). In these cases, please do contact support and we can discuss workarounds.


MINOR Open Éowyn
AFFECTING
Éowyn
STARTED
Jan 23, 07:00 PM (17¾ days ago)
DESCRIPTION
Openreach have notified us of the precautions they are taking in light of storm Éowyn. This involves them not sending Engineers on Friday to areas with 'red' warnings. This may may missed appointments for install or repair activities whilst these warnings are in place.

MINOR Closed General
AFFECTED
General
STARTED
Feb 05, 11:20 PM (4½ days ago)
CLOSED
Feb 05, 11:30 PM (4½ days ago)
DESCRIPTION
We had a network incident lasting a couple of minutes from 23:20. This caused one of our transit routers to fail and it is currently offline. This was one of our routers to 'Lumen'. We have 5 other transit routers, including one that is also connected to Lumen from a different location so this is not causing any further problems.
Resolution:

MINOR Closed Routing
AFFECTED
Routing
STARTED
Jan 27, 08:28 PM (13¾ days ago)
CLOSED
Jan 27, 09:38 PM (13¾ days ago)
DESCRIPTION
We're investigating a large number of drops and reconnects of our L2TP service (l2tp.aa.net.uk)
Resolution:

MINOR Closed Database
AFFECTED
Database
STARTED
Jan 24, 07:02 AM (17¼ days ago)
CLOSED
Jan 24, 07:22 AM (17¼ days ago)
DESCRIPTION
Some VoIP calls and the control pages were affected by a Database issue this morning between 7AM and 7:20AM.
Resolution: Our database problem seems to be caused by a recent Linux kernel update. We're tracking the upstream bug and have reverted to a previous kernel.

MINOR Closed SIP2SIM
AFFECTED
SIP2SIM
STARTED
Jan 23, 02:00 PM (18 days ago)
CLOSED
Jan 23, 03:30 PM (18 days ago)
DESCRIPTION
We are investigating a problem with our SIP2SIM servers registering to customer's own PBXs. This isn't affecting SIP2SIM customers where we are also providing the VoIP service/number.
Resolution:

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Jan 23, 10:03 AM (18¼ days ago)
CLOSED
Jan 23, 10:14 AM (18¼ days ago)
DESCRIPTION
We're investigating a problem with VoIP registrations having problems.
Resolution: Early indications looks to point the cause at our REDIS cluster having failing over when the master had a problem. Further investigations will continue.

MINOR Closed Control Pages
AFFECTED
Control Pages
STARTED
Jan 21, 09:22 AM (20¼ days ago)
CLOSED
Jan 21, 09:30 AM (20¼ days ago)
DESCRIPTION
At the moment our control pages appear to be offline, our engineers are investigation this as a matter of urgency.
Resolution: The control pages and databases are up and running, investigations in to the cause continue.

MINOR Closed Storm Darragh
AFFECTED
Storm Darragh
STARTED
Dec 07, 05:00 PM (2 months ago)
CLOSED
Jan 03, 02:00 PM (1¼ months ago)
DESCRIPTION
As you would imagine, Storm Darragh will be causing broadband problems across the country with fallen trees, power failures, road closures etc. Openreach have put on extra staff during this time and will work to repair affected services as best as they can - but repair times may be longer than usual. If you are affected by faults, in most cases Openreach will already be aware. Running a line test from, the Control Pages may well show this, however please do email in and we'll try to update you.
Resolution:

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Nov 28, 12:10 PM (2¼ months ago)
CLOSED
Dec 03, 10:50 AM (2¼ months ago)
DESCRIPTION
We're seeing problems with Zoipier and our VoIP service. Zoipier is a 3rd party soft phone that also has a service that manages calls via their own servers. We are seeing multiple registrations from the Zoipier servers. We're not yet sure of the cause or the impact this will have on our customers, but it looks like the Zoipier service is malfunctioning in some way.
Resolution: The issue has gone away... Zoiper say their side was working as expected, but us seeing hundreds of registrations per account from Zoipier didn't seen expected to us!