Recent posts
Timeline view of events on our network and systems

Events from the AAISP network from the last few months on a scrollable timeline. Mouseover for brief details, click incident to view the full post.

MAINTENANCE Completed Broadband
AFFECTING
Broadband
STARTED
Jan 29, 06:00 AM (9½ hours ago)
CLOSED
Jan 29, 07:28 AM (8 hours ago)
DESCRIPTION
We will be carrying out some work Wednesday morning from 6AM through to 8AM as part of bringing up new hostlinks to BT. We do not expect this to have an impact on services, but it is a period where work is being carried out on our core network and so is considered an 'at risk' period of time.
Resolution:

MAINTENANCE Planned Email services
AFFECTING
Email services
STARTING
Jan 30, 06:00 AM (14¼ hours )
DESCRIPTION
We will be carrying out tests of some internal systems on Thursday morning from 6AM through to 7AM. These tests may have a small impact of connectivity to other services, namely POP3 and IMAP for email. Any disruption should be short lived and not noticeable.

MAJOR Closed Broadband
AFFECTED
Broadband
STARTED
Jan 22, 11:10 PM (6½ days ago)
CLOSED
Jan 23, 09:05 AM (6¼ days ago)
DESCRIPTION
We're investigating a problem with some broadband lines showing 50% packetloss from just after 11PM.
Resolution: The problem was resolved just after 9AM. the reason for this outage is in https://aastatus.net/33308 "Networks have investigated and advised they found a number of errors on a card in LOH which was erroring and causing back plain errors."

MAINTENANCE Completed Extra Capacity
AFFECTING
Extra Capacity
STARTED
Jan 21, 09:00 AM (8¼ days ago)
CLOSED
Jan 21, 04:30 PM (7¾ days ago)
DESCRIPTION
We have upgraded our LINX LON1 peering port in Telehouse to 10G. This increases our capacity and more importantly our resilience. We now have 10G ports to LINX in two separate locations.
Resolution:

MAINTENANCE Completed Broadband
AFFECTING
Broadband
STARTED
Jan 19, 07:00 AM (10¼ days ago)
CLOSED
Jan 19, 07:31 AM (10¼ days ago)
DESCRIPTION
We will be carrying out some work Sunday morning from 7AM through to 9AM as part of bringing up new hostlinks to BT. We do not expect this to have an impact on services, but it is a period where work is being carried out on our core network and so is considered an 'at risk' period of time.
Resolution:

MAINTENANCE Completed Opening times
AFFECTING
Opening times
STARTED
Dec 06, 01:00 PM (1¾ months ago)
CLOSED
Jan 02, 11:00 PM (26½ days ago)
DESCRIPTION

Here are the dates that our office is open and closed over the Christmas and new year period. When we're open we will have staff available via our usual channels (Phone, IRC, Email, webchat etc).


December:
Fri 20th 8-6
Sat 21st 10-2
Sun 22nd Closed
Mon 23rd 8-6
Tue 24th 8-2
Wed 25th Closed
Thu 26th Closed
Fri 27th 9-4
Sat 28th Closed
Sun 29th Closed
Mon 30th 9-4
Tue 31st 9-2

January:
Wed 1st  Closed
Thu 2nd 8-6, and then back to normal hours

Resolution:

MINOR Closed Data SIMs
AFFECTED
Data SIMs
STARTED
Jan 13, 09:00 AM (16¼ days ago)
CLOSED
Jan 15, 04:30 PM (13¾ days ago)
DESCRIPTION
Some of our data SIMs are failing to connect. The problem actually started on Friday and has been confirmed today. This is affecting our data-only SIMs, and not our sip2sim's.
Resolution:

MINOR Closed VoIP
AFFECTED
VoIP
STARTED
Jan 14, 01:00 PM (15 days ago)
CLOSED
Jan 14, 05:30 PM (14¾ days ago)
DESCRIPTION
We're investigating problems with some incoming calls on our VoIP service.
Resolution:

This was quite a difficult problem to diagnose and we apologise to those affected. The problem affected, intermittently, about a quarter of phones that register to our VoIP service. Customers who we send calls to your own server or we redirect to other numbers were not affected.

The problem was caused by a misconfigured or buggy phone which hit an edge-case bug in our code. This caused registration updates of that phone to fail. This only affected one of four back-end servers, but it did mean that further registration attempts from other phones to this back-end server also failed. A short term fix was applied and registration details were then being updated successfully.

We do have already lots of monitoring and logging from our VoIP platform but this fault has shown that we can do better and we will be working to improve this so as to help diagnose faults quicker in future.


MAINTENANCE Completed Email services
AFFECTING
Email services
STARTED
Jan 09, 07:00 AM (20¼ days ago)
CLOSED
Jan 09, 07:27 AM (20¼ days ago)
DESCRIPTION
We will be carrying out tests of some internal systems on Thursday morning from 7AM through to 7:30AM. These tests may have a small impact of connectivity to other services, namely POP3 and IMAP for email. Any disruption should be short lived and not noticeable.
Resolution: