At 00:42, a large number of lines across all carriers disconnected, and then reconnected. Some lines may have taken longer than others to come back, however session numbers now are noted to have slowly recovered to their usual levels. During this outage, a significant number of BT lines have ended up biased to one LNS in particular which will need dealing with.
As session numbers have stabilised and traffic levels look normal, a further investigation into this event will follow in the morning, along with plans to move customers off of I.gormless where the large number of BT sessions have accumulated.
We expect to do some PPP restarted early evening before the evening peak traffic to put lines back on the right LNS. This will not be all customers. We are then looking to do some PPP restarts over night during the weekend to distribute over the newly installed LNSs.
The original issue has gone away, because of other problems today (DoS attack) we expect to be rebalancing lines later in the day and over night anyway. Thank you for your understanding.