We seem to have lost access to machines in Harbour Exchange Square.
This includes one of our key machines for RADIUS authentication for broadband lines (clueless) and our accounts server (priceless), customer web servers (Limitless) and a few hosted machines.
We are trying to identify the cause of the problem now.
We have managed to confirm it is not a power issue
We are gettign someone to check the rack in HEX now.
The backup RADIUS and DNS servers are working as they should.
This appears to be an issue with our main firewall in HEX. It is firewalling rather too well all of a sudden.
We are just waiting on a reboot now. We believe we have found the cause of the issue though so can take some preventative measures once the reboot is complete.
Reboot complete - all working
One slight side effect - session tracking timed out as the RADIUS server could not see the LNS. This meant PPP restarts for most lines at some point during the night and a few may do so during the day (on the hour). Until then usage is not being meter for those lines.
We will be applying an update to the firewall shortly