Time travel successful: database rewound by 24 hours
A good recovery, eh? :)
Yesterday we pushed out a bug fix that, unsurprisingly, turned out to be a bit buggy itself. At 2:30 PM NST today, we went down for about 15 minutes to move the site back to its previous version, including undoing that “fix” for the moment. Phew.
The “fix” seemed to cause issues with saving new data to the server, resulting in contributions being recorded and points being awarded, but with the data never actually getting saved. Whoops. As such, since none of today’s contributions really saved correctly in the first place, they have been wiped from the system. Sorry! Stability wins over point counts in the grand scheme of things.
We downloaded a copy of the glitched database before restoring the old copy, so that we can better diagnose the associated issues and figure out why a theoretically good patch went wrong. (“In theory, theory and practice are the same. In practice, they are not.”)
Thanks for sticking with us through the messy bits :) We may see another release of this experimental bug fix in the near future, with risk of database rollback. If so, we’ll be sure to let you know so you don’t go crazy submitting just to have it all be lost.
Sorry for the trouble, and thanks for using Dress to Impress! Y’all are the best :)
