Losing your data – forever

Losing data is never a good thing, but losing data forever, for a business is unthinkable. That’s why I had to respond immediately when I read the article that ran this morning in Cloud Pro about the lightning strike that hit one of Google’s data centres four times and has resulted in some people losing their data forever. Apparently a number of the disks in the Belgian data centre were completely wiped, meaning some people have permanently lost files. People losing their data forever is not a statement that anyone ever wants to see. It’s also not a message that a data storage provider ever wants to have to give to their customers. But this is the message that Google is going to be delivering or has already had to deliver to some of its customers today.

The statement that Google has issued stating that only 0.000001 per cent of disk space was permanently affected will, I am afraid, not be of any interest to the individual customers that have had their data wiped.

Google went on to say that in almost all cases the data was successfully committed to stable storage, although manual intervention was required in order to restore the systems to their normal serving state, but that in a very few cases, recent writes were unrecoverable, leading to permanent data loss on the Persistent Disk.
In my view this is all symptomatic of the limitations of always-on disk-based storage. Storage that is susceptible to mains electricity surges and spikes (and the even more terrifying but much rarer electromagnetic pulse (EMP)). It is also a wake-up call for people who entrust their data (and it would seem, the only copy of their data) to storage providers like Google that use traditional disk-based storage.

This highlights that not only is disk short-term, expensive and not very environmentally green, but it is also fragile.

Google’s Compute Engine has suffered a number of problems recently, with outages caused by software updates and various other issues that are under investigation, so this is definitely not good news for the company.

The message that we promote about not losing your data ever is the opposite to this and certainly a message that Google will not be able to deliver. It is, however, the message that Arkivum lives by and is the reason we have a 100% data integrity guarantee. Our data storage and archive services are based on tape and are designed to deliver data integrity over very long periods of time (decades), irrespective of the data volumes. A crucial reason why we use tape instead of disk is that tape is offline. It is also long-term is and it is economically much more sustainable than disk, plus it is green (i.e. unlike disk, tape is not always on.)

Google did go onto explain that auxiliary systems managed to restore the power quickly, but it was the storage devices that had previously suffered degeneration from extended or repeated battery drain that lost some recent information. Well that’s okay then – as long as you are not one of the companies that have unfortunately lost their data forever.