The server helene is experiencing some terrible, horrible, no-good issues: at this time. all services are down. While we do have an active session to the server, it is not responding to any command being issued to it. We are examining the issuers we are encountering, and attempting to get it back on track; however, it may wind up being necessary to restore sites to another server if we are unable to return helene to production.
At the moment, there is no ETA on return, as we will need to have a direct console with the server to determine its fitness to return to service. Whatever the case is for helene, there is likely to be at least a few hours for a resolution or transfers to another server.
We will post updates as available and necessary for this server.
If you have any questions related to this emergency notification for helene, please let us know via the usual means.
Our apologies for this disruption to service. We are working as quickly as possible to resolve the issue.
The issues with helene are too numerous (and jargon-filled) to list. Suffice to say that helene just let herself go, all at once.
We did rescue backups - most of the backups, as there are a few where it appears the data was mangled. The affected sites were either in the stripe that was bad, or were being written at the time the server was going over the cliff. At this time, all sites we could recover have been restored to the server leia (yes, Leia like in Star Wars). We are continuing our attempts to recover data from helene. If you receive errors when checking mail and you're using the server name, swap out "helene" for "leia"(no quotes) in your email client/on your device.
If your site is not up and you were on helene, or if you site is not up and you're not sure if you were on helene, please open a ticket with us. Important: please contact us from an email address you can check. If you use an address at your domain and your mail was handled on helene, you will not receive any responses.
If you have any questions about today's tech-related marathon, please let us know via the usual means.
Friday, August 21, 2020