Power outage in Maidenhead data centre
MINOR Closed Maidenhead Colocation
STATUS
Closed
CREATED
May 29, 10:23 PM (12¾ years ago)
AFFECTED
Maidenhead Colocation
STARTED
May 29, 10:07 PM (12¾ years ago)
CLOSED
May 31, 10:20 AM (12¾ years ago)
REFERENCE
1525 / AA1525
INFORMATION
  • INITIAL
    12¾ years ago by James

    IT looks like a few severs rebooted, so suggests a power problem. Trying to get some more information now.

    IT would affect web and email hosted services as well as VOIP.

  • UPDATE
    12¾ years ago

    It has been confirmed that this was a problem with power. It is being worked on.

    There are a few minor problems, like one of our spam checking servers is offline (the other servers should cope), one of our customer facing SMTP relays died (no longer in DNS so not customer affecting) and customised voicemail messages are not working on our VoIP service.

    The accounts system web interface is down too (although the accounts system itself is fine).

    These are not major problems, and we'll continue to work on them in the morning.

  • UPDATE
    12¾ years ago

    It looks like there are some ongoing connectivity problems with Palsant's transit feed. They are manifesting themselves as brief outages, but it doesn't look too serious.

    We'll post details when we know more.

  • UPDATE
    12¾ years ago

    Power went off at 22:07:47 and was restored at 22:10:59

    Engineers are on site this morning to resolve remaining issues with some servers.

    Transit seems to be stable now.

  • UPDATE
    12¾ years ago

    Most services are working correctly - some issues with voicemail/announcement messages at present, but this is being worked on. One of the outgoing mail servers has not come back to life and will be worked on this morning so that the mail queue can be sent ASAP.

  • UPDATE
    12¾ years ago

    All services are working again now. The data centre have completed their investigations and have determined that the outage was caused by a faulty UPS component which failed during planned maintenance. The power feed to the data centre is currently running without UPS backup and should be seen as at-risk in the event of a mains power outage. The data centre staff expect to have the UPS back in-line by 22:00 this evening.

  • Closed