Outages
Maintenance
Our Network:
Major Outages

0

Minor Outages

1

Happening Now

0

Future Planned

0

Open Events:
STATUS
Open
CREATED
Mar 29, 08:46 AM (1¾ days ago)
AFFECTING
CityFibre
STARTED
Mar 28, 02:00 AM (3¼ days ago)
REFERENCE
42529 / AA42529
MASTODON
INFORMATION
  • INITIAL
    3¼ days ago by Andrew

    We're seeing low levels of continuous packet loss on CityFibre circuits in Maidenhead (Around 5%). This started at 2AM on Monday.

  • UPDATE
    1¾ days ago by Andrew

    The timing of the loss correlates with a CityFibre planned OLT software upgrade in the Maidenhead area (Their reference for this work was CHG0073887)... this has been reported to CityFibre.

  • UPDATE
    23¾ hours ago by Shaun

    CF have found a config issue and are taking steps to fix, update to follow ........

  • UPDATE
    11 hours ago by Andrew

    CityFibre have scheduled work to to fix their OLT configuration on 18th and 19th April! This is under their reference of CHG0076369. This is not acceptable and we are escalating. We only have a couple of circuits in Maidenhead, but we'd expect all CityFibre circuits in Maidenhead which are connected to the OLTs to all be experiencing 5% packetloss which will be disrupting their internet connections.

  • NEXT UPDATE...

    Due in 3 hours

Recently Closed Events:
STATUS
Closed
CREATED
Mar 30, 10:08 AM (22 hours ago)
AFFECTED
General
STARTED
Mar 30, 10:00 AM (22¼ hours ago)
CLOSED
Mar 30, 11:00 AM (21¼ hours ago)
REFERENCE
42530 / AA42530
MASTODON
INFORMATION
  • INITIAL
    22¼ hours ago by Andrew

    We're investigating connectivity problems.

  • UPDATE
    22 hours ago by Andrew

    Network is recovering

  • UPDATE
    21½ hours ago by Andrew

    We are seeing some packet loss on our network again, we're still investigating this.

  • UPDATE
    21 hours ago by Andrew

    The Network is stable at the moment but the cause of this is still under investigation.

  • UPDATE
    20¼ hours ago by Andrew

    For information, the problems have occurred for minutes around: 08:55, 10:00, 10:10, 10:30. Customers would have had 'routing' problems during these times - ie problems reaching websites and places on the internet. More information to follow.

  • UPDATE
    19¾ hours ago by Andrew

    The disruption today has been caused by problems with our 'route servers'. These are BGP routers that manage all our internal and external IP address announcements and routing information for our network - they exchange IP address information between all our LNS routers and our edge transit/peering routers. For resilience, we run two route servers, in separate data-centres. They both exchange routes with all the other routers on our network. Each route server is also physically connected to two network switches.

    The disruptions today were a result of both of our route dropping their Ethernet connections to their switches at a similar time, which caused a BGP sessions to drop which cascaded to the routing problems that were experienced at the time.

    We are still not 100% sure of the cause and investigations are continue. However, later software does manage the Ethernet ports slightly different and at 11:30 we upgraded the software on one of the router servers.

    We are still monitoring the network

  • UPDATE
    18 hours ago by Andrew

    Network has remained stable since 10:30AM

  • Closed
Broadband blip graph

The graph shows the last few hours of logins and logouts of ADSL, VDSL, SIMs and L2TP circuits.

The current time is on the left. Green is login, red is logout.

If there are spikes, then this shows a large number of logouts, which may indicate an outage or planned work happening.

You can click on a spike to search for incidents or maintenance that were open around that time.

About our status page

This is the status page of Andrews & Arnold Ltd.

Our status page shows outages (problems) and maintenance (planned work) that happen on our own network and systems and also that of our suppliers networks and systems. We try and ensure this site is updated as soon as possible with incidents as they happen. Live discussion of issues is usually available on IRC.

The last update was Yesterday 21:08:16

Contacting us
Our support number is 033 33 400 999, or you can email support@aa.net.uk or text 01344 400 999 to raise a support ticket.

Spotted a Major Service Outage? (MSO)
A Major Service Outage disrupts the service of multiple customers simultaneously. If you believe that a problem affects multiple customers, and is not mentioned here already, text the number above. Begin the text with "MSO". This alerts multiple staff immediately, waking them if necessary. False alarms (i.e. raising MSO for a single line being down) may result in your number being prevented from raising MSO alerts in future. More info.

Regular Maintenance
Thursday evenings, from 10pm, are designated as a general maintenance window where we will perform non-service affecting updates.