Azul,
as many of you will have noticed, our webpresence has been compromised throughout the last two weeks or so due to what our hosting provider defined as a "rather significant failure with (their) primary server". This began with me being unable to access our backend, continued with various DNS woes causing outages for some people in certain areas or using certain ISPs, and ended with a complete outage on March 1-ish.
What happened?
Due to the failure, as you may have noticed, we lost all data that was changed between Feb 16th and the ultimate outage on Mar 1st - Witt posts and PMs, Wiki articles, talossa.com content, and so on. Again, quoting from DoRoyal,
My possibly inaccurate interpretation is: we were on server A, then our data got moved to server B, but we still were interacting with server A. When server A finally went offline (or our address finally pointed to B -- remember all our DNS woes before the actual outage?), we were left with the data on B, which was by then two weeks out of date.
What happened *then*?
Mostly restoring all we could, recreating all subdomains and moving files to the correct places so our new server/control panel wouldn't complain anymore. This took the better part of yesterday for me and new MinTech Dan T. Most low maintenance subdomains were up pretty quickly, Witt was restored around noon TST yesterday, the Wiki took a bit longer and as of earlier today is now up as well.
Didn't we have backups?
Yes, Witt and Wiki are backed up weekly. However, due to the same frontend-backend misconfiguration issue, the backups were also unable to pick up any fresh data after the 16th.
Anything else missing?
We may have lost some Witt attachments and Wiki files. This may be related to why all avatars were reset, incidentally. I tried restoring all I could and there's more backups coming that were done by our host, I'm told. Regardless, if you had a CoA, it still can be linked to from heraldry.talossa.com , or from the wiki.
What do I (the reader) need to do?
DM me if there's anything wrong or broken, and if you had a talossa.com email address, especially an official or mission-critical one, that needs restoring.
Anything else you (Lüc) need to do before we're 100% back up and running?
Yes, some customizations are missing, such as the favicons (no biggie) and Tapatalk integration. Also, as mentioned, email redirects need to be restored. All shall be done later today. That said, you are safe to use all of our services. Even if we can restore additional missing content, we should be able to plug it back in without disrupting fresh data coming in from today onwards.
Thank you to everyone who helped restoring service in some way or the other. This was in the middle of a government transition no less, so for some of them it wasn't even their job anymore. Thank you to Txec and Miestră for interfacing with DoRoyal, Dan T for helping with the actual recovery job, and Breneir for the public-facing updates.
as many of you will have noticed, our webpresence has been compromised throughout the last two weeks or so due to what our hosting provider defined as a "rather significant failure with (their) primary server". This began with me being unable to access our backend, continued with various DNS woes causing outages for some people in certain areas or using certain ISPs, and ended with a complete outage on March 1-ish.
What happened?
Due to the failure, as you may have noticed, we lost all data that was changed between Feb 16th and the ultimate outage on Mar 1st - Witt posts and PMs, Wiki articles, talossa.com content, and so on. Again, quoting from DoRoyal,
QuoteThe front end of our hosted websites remained online, allowing for front end edits to be made. The backend panel, however, including our backup processes, stopped working completely on the 16th, (meaning that) any edits that were made after the backup process and backend panel stopped working, would only be saved to the old server, and thus, were lost in the migration.
My possibly inaccurate interpretation is: we were on server A, then our data got moved to server B, but we still were interacting with server A. When server A finally went offline (or our address finally pointed to B -- remember all our DNS woes before the actual outage?), we were left with the data on B, which was by then two weeks out of date.
What happened *then*?
Mostly restoring all we could, recreating all subdomains and moving files to the correct places so our new server/control panel wouldn't complain anymore. This took the better part of yesterday for me and new MinTech Dan T. Most low maintenance subdomains were up pretty quickly, Witt was restored around noon TST yesterday, the Wiki took a bit longer and as of earlier today is now up as well.
Didn't we have backups?
Yes, Witt and Wiki are backed up weekly. However, due to the same frontend-backend misconfiguration issue, the backups were also unable to pick up any fresh data after the 16th.
Anything else missing?
We may have lost some Witt attachments and Wiki files. This may be related to why all avatars were reset, incidentally. I tried restoring all I could and there's more backups coming that were done by our host, I'm told. Regardless, if you had a CoA, it still can be linked to from heraldry.talossa.com , or from the wiki.
What do I (the reader) need to do?
DM me if there's anything wrong or broken, and if you had a talossa.com email address, especially an official or mission-critical one, that needs restoring.
Anything else you (Lüc) need to do before we're 100% back up and running?
Yes, some customizations are missing, such as the favicons (no biggie) and Tapatalk integration. Also, as mentioned, email redirects need to be restored. All shall be done later today. That said, you are safe to use all of our services. Even if we can restore additional missing content, we should be able to plug it back in without disrupting fresh data coming in from today onwards.
Thank you to everyone who helped restoring service in some way or the other. This was in the middle of a government transition no less, so for some of them it wasn't even their job anymore. Thank you to Txec and Miestră for interfacing with DoRoyal, Dan T for helping with the actual recovery job, and Breneir for the public-facing updates.