Events from the AAISP network from the last few months on a scrollable timeline. Mouseover for brief details, click incident to view the full post.
Here are the dates that our office is open and closed over the Christmas and new year period. When we're open we will have staff available via our usual channels (Phone, IRC, Email, webchat etc).
December: Fri 20th 8-6 Sat 21st 10-2 Sun 22nd Closed Mon 23rd 8-6 Tue 24th 8-2 Wed 25th Closed Thu 26th Closed Fri 27th 9-4 Sat 28th Closed Sun 29th Closed Mon 30th 9-4 Tue 31st 9-2 January: Wed 1st Closed Thu 2nd 8-6, and then back to normal hours
This was quite a difficult problem to diagnose and we apologise to those affected. The problem affected, intermittently, about a quarter of phones that register to our VoIP service. Customers who we send calls to your own server or we redirect to other numbers were not affected.
The problem was caused by a misconfigured or buggy phone which hit an edge-case bug in our code. This caused registration updates of that phone to fail. This only affected one of four back-end servers, but it did mean that further registration attempts from other phones to this back-end server also failed. A short term fix was applied and registration details were then being updated successfully.
We do have already lots of monitoring and logging from our VoIP platform but this fault has shown that we can do better and we will be working to improve this so as to help diagnose faults quicker in future.