Since 2:40AM many CityFibre lines have had high latency and packet loss making them unusable.
This is affecting other ISPs too.
We have managed to get hold of someone at CityFibre - they had other calls reporting problems, they are investigating. There was mention of overnight planned work, so this could be the cause of the problem... Updates to follow.
Just a bit more info on what we see: Since 2:40AM, MANY of our CityFibre circuits are showing 140ms Latency and around 60% packetloss. Some services are also dropping and restarting their connection completely. Some lines are unaffected by this problem.
Latest update from CF: We are aware of an ongoing incident affecting a number of services. Our Engineers are conducting preliminary investigations to determine the comprehensive Service Impact Analysis. We apologise for the inconvenience caused. Our main priority is to deliver the levels of service that our customers deserve and as such we have invoked our Major Incident Process. CityFibre are working to affect a full restoration as soon as possible. We will continue to issue regular updates until all services have been restored. Further details will be issued within 15 minutes.
Probably around half of our CityFibre estate are affected... Affected lines are mostly in the south/east quadrant of the UK. Taking a small and random sample:
We're starting to see some improvement on lines...
CityFibre lines look to be working as normal.
From CityFibre: "CityFibre is pleased to inform you that the issue was resolved at approximately 08:50 on 12/03/2025. A configuration issue impacted several services, but the configuration has since been updated, resolving the issue." We have requested the "Reason for outage" document from Cityfibre, which we should have within 10 days.