All The Tropes Wiki Project, Part XXVII

[robkelk]

There's been one update:

Adding to the above, while the servers which actually hold image files are unaffected, the server that verifies that users have the proper permissions to view files and which directs traffic is down. This means that requests for images might return errors such as "Unauthorized. You do not have permission to view this file." and such. We are working to correct the issue but have no ETA at the moment for when this will be fixed. Agent Isai Talk to me! 00:36, 12 April 2023 (UTC)

Speaking as somebody who's spent a decade in Storage and Backup, this doesn't sound like a disk issue to me. This is a security issue - not "we didn't have enough security to stop a hack", but "the security that we have is malfunctioning".

Still no images. I've asked for an update.

EDIT: And that request got me the Phabricator ticket number.

From the looks of things, swiftac is going to need to be rebuilt. Some of the data can be scavenged, however much of the VM was corrupted beyond the point of usability. I also believe that proxmox will need to be reinstalled on cloud11, as the previous install is likely corrupted in a similar manner to swiftac.

Oh, joy. This is not going to have a quick fix. This is one of those "every patch reveals another issue" breaks.