Last 10 Maintenance posts, sorted by last updated
Order posts by limited to posts

MAINTENANCE Completed FTTP
AFFECTING
FTTP
STARTED
Aug 06, 01:00 AM (5¾ days ago)
CLOSED
Aug 06, 05:08 AM (5¾ days ago)
DESCRIPTION

We're wanting to do another LNS move for 160M and faster FTTP customers. (Hopefully this will be the last for a little while!)

We will performing the LNS 're-shuffle' on Saturday morning, starting from 1AM affecting 160M and faster FTTP circuits. This means we will force a PPP reconnect for these circuits so that the reconnect to a different LNS.

The 'downtime' for each circuit would typically be a few seconds. The time that this happens can be chosen by customers, the default is 1AM, but the 'LNS reset' setting on our Control Pages can be changed on a per circuit basis by customers if a later time would be more convenient.

This type of work is happening fairly frequently at the moment as we upgrade one LNS at a time with newer software. This is part of our project to improve the performance of our FireBrick FB9000. More information about this can be read here: https://www.aa.net.uk/etc/news/fb9000-lns-progress/


Resolution: This has been completed.

MAINTENANCE Completed FTTP
AFFECTING
FTTP
STARTED
Aug 05, 01:00 AM (6¾ days ago)
CLOSED
Aug 05, 03:30 AM (6¾ days ago)
DESCRIPTION

160M and faster FTTP customer will see 2 to 3 PPP reconnects between the hours of 1AM and 4AM as we update software.

We are needing to upgrade the 'auxiliary' software on our pool of 'Witless' LNSs that handle 160M and faster FTTP circuits. This is the low level software that initialises the FIreBrick when it boots and also performs hardware monitoring. The update alters the thresholds of the power rail monitoring making it less zealous to order prevent unnecessary reboots - as we saw in https://aastatus.net/42452


Resolution: The work has been completed.

MAINTENANCE Completed FTTP
AFFECTING
FTTP
STARTED
Aug 04, 01:00 AM (7¾ days ago)
CLOSED
Aug 04, 08:23 AM (7½ days ago)
DESCRIPTION

We will performing a software update and LNS 're-shuffle' on Thursday morning, starting from 1AM affecting 160M and faster FTTP circuits. This means we will force a PPP reconnect for these circuits so that the reconnect to a different LNS.

The 'downtime' for each circuit would typically be a few seconds. The time that this happens can be chosen by customers, the default is 1AM, but the 'LNS reset' setting on our Control Pages can be changed on a per circuit basis by customers if a later time would be more convenient.

This type of work is happening fairly frequently at the moment as we upgrade one LNS at a time with newer software. This is part of our project to improve the performance of our FireBrick FB9000. More information about this can be read here: https://www.aa.net.uk/etc/news/fb9000-lns-progress/


Resolution: This was completed successfully.

MAINTENANCE Completed Test LNS
AFFECTING
Test LNS
STARTED
Jul 30, 01:00 AM (12¾ days ago)
CLOSED
Jul 31, 01:26 AM (11¾ days ago)
DESCRIPTION
We have a small number of customers on our test LNS, we'll be upgrading the software over the weekend - out of hours. Customers may notice a PPP drop, but service would only be affected for a few seconds.
Resolution: This has been done.

MAINTENANCE Completed FTTP
AFFECTING
FTTP
STARTED
Jul 26, 01:00 AM (16¾ days ago)
CLOSED
Jul 26, 09:00 AM (16½ days ago)
DESCRIPTION

We will performing a software update and LNS 're-shuffle' on Tuesday morning, starting from 1AM affecting 160M and faster FTTP circuits. This means we will force a PPP reconnect for these circuits so that the reconnect to a different LNS.

The 'downtime' for each circuit would typically be a few seconds. The time that this happens can be chosen by customers, the default is 1AM, but the 'LNS reset' setting on our Control Pages can be changed on a per circuit basis by customers if a later time would be more convenient.

This type of work is happening fairly frequently at the moment as we upgrade one LNS at a time with newer software. This is part of our project to improve the performance of our FireBrick FB9000. More information about this can be read here: https://www.aa.net.uk/etc/news/fb9000-lns-progress/


Resolution: This work was completed.

MAINTENANCE Completed FTTP
AFFECTING
FTTP
STARTED
Jul 22, 01:00 AM (20¾ days ago)
CLOSED
Jul 22, 07:00 AM (20½ days ago)
DESCRIPTION
This is a re-attempt of the upgrade that was attempted earlier in the week.

FTTP Customers with lines 160M or faster connect to our pool of LNSs named 'Witless', these LNSs have a software upgrade planned and this will mean a PPP drop between midnight and 6AM on 20th July. As usual with a PPP drop the line would be off for a few seconds whilst the customer router reconnects.

For most customers, the time of the PPP drop will be as per the 'LNS Reset' time on the Control Page which can be adjusted by customers.
Resolution: This work was completed.

MAINTENANCE Completed Test LNS
AFFECTING
Test LNS
STARTED
Jul 21, 01:00 AM (21¾ days ago)
CLOSED
Jul 21, 02:27 AM (21¾ days ago)
DESCRIPTION
We have a small number of customers who are using our test LNS (thank you!), we will be upgrading the software overnight which will cause two PPP reconnects. Staff will monitor the connections as this work is carried out.
Resolution: This work has been completed.

MAINTENANCE Completed FTTP Services
AFFECTING
FTTP Services
STARTED
Jul 19, 11:00 PM (23 days ago)
CLOSED
Jul 20, 03:54 PM (22¼ days ago)
DESCRIPTION
FTTP Customers with lines 160M or faster connect to our pool of LNSs named 'Witless', these LNSs have a software upgrade planned and this will mean a PPP drop between midnight and 6AM on 20th July. As usual with a PPP drop the line would be off for a few seconds whilst the customer router reconnects.

The time of the PPP drop will be as per the 'LNS Reset' time on the Control Page which can be adjusted by customers.


Resolution: As per https://aastatus.net/42444 the software had problems that affected some customers reconnecting. A new upgrade will be rescheduled later in the week.

MAINTENANCE Completed Routing
AFFECTING
Routing
STARTED
Jun 24, 03:00 AM (1½ months ago)
CLOSED
Jun 24, 04:04 AM (1½ months ago)
DESCRIPTION
We will enable IPv4 on a new link between our Maidenhead and London datacentres. There will be a brief outage for services in Maidenhead as routing configuration is changed. The impact should be minimal and only affect services hosted in Maidenhead which is mainly customer colocation and our VoIP servers.

Rescheduled for Friday 3AM


Resolution:

MAINTENANCE Completed Routing
AFFECTING
Routing
STARTED
May 25, 02:00 AM (2½ months ago)
CLOSED
May 25, 03:23 AM (2½ months ago)
DESCRIPTION
We have a new link between our Maidenhead and Harbour Exchange POPs (Point of Presence) which will be made live in the early hours of May 25. Impact on customers should be none or very minimal. We'll update this post upon completion.
Resolution: IPv6 routing was enabled without problem, but enabling IPv4 did cause a problem and was reverted. We will review this and will reschedule a time to bring up IPv4 routing. Our apologies to those who were affected by the routing problems that lasted for a few minutes at 3AM.