Quoted By:
Hey fellow digital textbook hoarding patricians, remember to maintain backups and error-correcting codes for your collection. Storage can and will fail and corrupt bits and pieces of your collection. Maybe even lose it.
If you're on linux, you can zip up your collection into a tar.gz2 archive and then use a utility called "par2" to compute redundancy checks on that archive. And to back up your massive tar.gz2 archive, you can use "split" to split it up into small chunks which can be stored on more primitive filesystems like fat32.
I recently had a textbook get corrupted after a seemingly long time of no use. Shortly thereafter, my SSD failed. That was my master copy of all my stuff.
Thankfully, the first corruption spurred me to make tons of backups and ECC files.
With par2, you can set a variable amount of recovery for your ECC files. So, for example, you can make files that can recover 30% corruption of your collection. You can also, at the cost of a lot more storage, make files that recover up to 100% corruption. It's a command line option.