This was quite a difficult problem to diagnose and we apologise to those affected. The problem affected, intermittently, about a quarter of phones that register to our VoIP service. Customers who we send calls to your own server or we redirect to other numbers were not affected.
The problem was caused by a misconfigured or buggy phone which hit an edge-case bug in our code. This caused registration updates of that phone to fail. This only affected one of four back-end servers, but it did mean that further registration attempts from other phones to this back-end server also failed. A short term fix was applied and registration details were then being updated successfully.
We do have already lots of monitoring and logging from our VoIP platform but this fault has shown that we can do better and we will be working to improve this so as to help diagnose faults quicker in future.
We have had reports of issues within the 3 network overnight. This caused multiple blips for our data SIMs. At present our data SIMs seem to connect but not pass traffic.
We have yet to hear any information from our carrier. However we are currently chasing and will update once more information is available.