[RESOLVED] 02-18-08 Outage - Feedback and problems

[twhiting9275]

The feedback and problems thread directly related to this outage, and ONLY this outage.
Please remember to try to keep it civil!

[twhiting9275]

Just a quick follow-up here:
A number of you have said to me via email, the contact form, whathaveyou that your databases were corrupted, or tables didn't exist. I'm in the process of investigating these fully. The databases have been restored, but for some odd reason the backups didn't contain the forum information, of course, causing problems.

As stated, I'm in the process of investigating this and seeing what caused this, and how to get around this in the future.

[twhiting9275]

This will be my final reply on the topic, unless someone else has something to say .

After evaluating the problems with backups, a more robust setup was applied. This may result in minimal (< 1 minute) downtime of your forums every few hours, but will result in a much, much more stable system for restoration of accounts, databases, and the like.

I've also reduced the number of forums per database, which, of course, means that the possibilities of this error showing up in the future are even less.

Long story short:
Hardware fails, backups fail. Thankfully the sql data on the primary drive was usable, and we could move from there.

Secondary backups are being looked at, but they shouldn't be necessary with the setup in place now.