I’m running my media server with a 36tb raid5 array with 3 disks, so I do have some resilience to drives failing. But currently can only afford to loose a single drive at a time, which got me thinking about backups. Normally I’d just do a backup to my NAS, but that quickly gets ridiculous for me with the size of my library, which is significantly larger than my NAS storage of only a few tb. And buying cloud storage is much too expensive for my liking with these amounts of storage.

Do you backup only the most valuable parts of your library?

  • ShortN0te@lemmy.ml
    link
    fedilink
    English
    arrow-up
    5
    ·
    24 days ago

    I do not backup my media. When my zfs blows up, i need to start getting everything back again. I can live with it, it is nothing important. Thanks to sonarr/radarr etc, my media will recover itself over time anyway.

    Important stuff is backed up at least twice locally and 1 times off side.

    • CrabAndBroom@lemmy.ml
      link
      fedilink
      English
      arrow-up
      1
      ·
      24 days ago

      Yeah same here, my backup for media is basically just a text file with the names of all the folders in my Movies directory so I have a list of what to download again when the drive craps out. I could buy terabytes of extra storage or a NAS or something and make sure it’s all synced, but it’s not really worth the expense/trouble for me TBH.

  • jabjoe@feddit.uk
    link
    fedilink
    English
    arrow-up
    6
    ·
    25 days ago

    Remote storage (Pi at parents house with a big disk) and cron’ed btrfs send over ssh.

    • jay@mbin.zerojay.com
      link
      fedilink
      arrow-up
      4
      arrow-down
      1
      ·
      25 days ago

      You really shouldn’t trust anything important to a pi. I hope that you at the very least have that pi on a UPS if you’re going to risk your data this way.

      • jabjoe@feddit.uk
        link
        fedilink
        English
        arrow-up
        2
        ·
        25 days ago

        It’s a backup. On the main machine there are two disks (fast & big and slow & smaller) not in raid, with a btrfs copy.

        It would be quite an event to lose all three copies.

  • cmnybo@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    25 days ago

    You can put a big hard drive in an external enclosure and use it for offline backups. There is no point in paying for cloud storage for something you can just download again if needed. Save the cloud storage for backing up non-replaceable data.

  • Boomkop3@reddthat.com
    link
    fedilink
    English
    arrow-up
    3
    ·
    25 days ago
    • automated scheduled copies
    • syncing data to multiple machines
    • scheduled copy to the cloud (not particularly frequent tho)
  • hydrogen@lemmy.ml
    link
    fedilink
    English
    arrow-up
    8
    ·
    25 days ago

    “Cloud” storage is indeed more expensive. But depending where you live, you count the electricity cost in, and you use the storage ‘only’ for backups. Maybe it makes more sense to pay for remote storage in a datacenter. Check out Hetzner Storage Box, it’s what I use.

    If it’s still too expensive, maybe ask a friend or family member (maybe someone that uses your media) to setup a nas at their home for backup purpose. (I use this for my media)

    Make sure you encrypt your backups if you use a remote location for your backups.

    You have to decide what’s valuable for you. For me my media is, I can just download everything again, but the time I put in to have every movie the correct subtitles without ads, the correct posters, metadata etc. I value my time, I don’t want to do it again if I loose everything.

  • Azzu@lemm.ee
    link
    fedilink
    English
    arrow-up
    17
    arrow-down
    1
    ·
    25 days ago

    I feel like other people seeding is enough backup for me. I don’t backup my library at all.

  • randomaside@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    2
    ·
    24 days ago

    Data hoarding is a truly unique experience. Just my two cents

    • raid is not a backup. Don’t use raid5 unless you’re using a filesystem like zfs that checksums your data. Raid5 is vulnerable to scenarios with a “write hole” that leads to bit rot.

    • split up your dataset into smaller more manageable datasets so you can more easily back it up in different ways like external drives, cloud storage, etc. You can then limit the dataset size to never exceed the same of your backup target.

    • snapshots, use them. Snapshots in your filesystem can make your backups more manageable by only sending the differential data as opposed to something like Rsync which may need to rsync an entire file.

    I use ZFS and have found that compression with ZSTD works pretty well for getting extra use out of your disks but unless you have a lot of RAM and some special metadata NVME disks, don’t use reduplication as it will be a serious performance impact.

    Now if you aren’t using a FOSS system like truenas and instead you’re using a system like a qnap off the shelf, the qnap hybrid backup and sync manager has a really elegant solution for doing policy based differential backups to back blaze b2 storage. Not only does this give you a copy of your data, you also get immutable points in time archives of your data.

    Good luck in your data hoarding endeavors!

    • WhyJiffie@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      24 days ago

      Important clarification: snapshots only make backups faster if you do backups with zfs send, or with other filesystems they have the appropriate command too.

  • Blastboom Strice@mander.xyz
    link
    fedilink
    English
    arrow-up
    3
    arrow-down
    1
    ·
    25 days ago

    I think I’m bad at this

    I have 4 main places I put stuff:

    • My 2018 external 4tb WD HDD (filled up at around ¾)

    • My 1tb laptop ssd

    • My 256gb phone

    • My laptop’s previous 2016 1tb hdd


    On my external drive I put ~all of my data; my camera files, my screenshots, my phone’s app data (like expenses, call logs, contacts, sms, game data, fitness logs), documents etc.

    On my laptop I have some stuff which I havent synced to my external drive for around 3 years (oops), but they probably arent the most important stuff.

    On my phone I have a lot of important stuff, like around ⅔ of my total camera files (I try to keep the most important ones) and my app data.

    On my old laptop’s 1tb hdd I keep movies/series and personal books/notebooks I have scanned. Those data dont exist anywhere else. If they get lost, especially the scanned books, it’s gonna be bad, because it both took a lot of time to scan them and I have thrown away many of the physical books.

    If my external drive fails, around ¼ of the data it contains might be unrecoverable. They might not be the most important files, but still it’s gonna hurt a loooot.


    I’m currently in the process of reorganizing my files on my laptop and my external drive for various reasons, some of them being 1) I will clear unnecessary/duplicate/temporary/etc files (which will reduce the used space) and 2) it will help me sync my files better.

    In the near future I’ll probably buy 500gb lifetime on filen.io (cloud storage) to keep the most important stuff, possibly another 4tb drive to mirror my current one to this and ~hopefully I’ll make a nas next year to sync everything there.

    It’s just to expensive for me tho🫤. Filen storage is around 100€, 4tb another 100€ (or I might buy 6tb at 150€) and the nas I want to make costs around 800€…

    I want to make a nas to both store and stream stuff. Like a personal home server. I’m thinking of getting 2 12tb hdds and have one of two asynchronously mirror itself onto the other (that way one of the two will be off/disconnected ~most of the time, protecting it from wear and cyber attacks (not sure of the latter will work)).

  • LiPoly@lemmynsfw.com
    link
    fedilink
    English
    arrow-up
    5
    ·
    25 days ago

    Personally, I back up everything on my NAS except my movie library, because that is something I can relatively easily restore by just downloading buying it again, and because it’s of course the biggest chunk of data. For the other data, I’m using a very affordable Hetzner server auction system with a lot of disks in a striped array. This gives me the maximum amount of storage, and given that I can just create the backup again should the stripe fail, I’m not worried about redundancy on the backup itself.

  • ChonkaLoo@lemmy.zip
    link
    fedilink
    English
    arrow-up
    3
    ·
    25 days ago

    I have a couple of external USB drives I bought on sale I backup my NAS to once a week. It’ll protect against drive failure at least. Almost got hit by ransomware a while back so I don’t keep anything on there without some backup.

    • ShortN0te@lemmy.ml
      link
      fedilink
      English
      arrow-up
      2
      ·
      24 days ago

      Have you read upon the actual recovery experience with cloud backup personal?

      It is very impractical to do a recovery from this service.

      • XNX@slrpnk.net
        link
        fedilink
        English
        arrow-up
        1
        ·
        24 days ago

        How so? You can download it all or download specific files or folders

        • ShortN0te@lemmy.ml
          link
          fedilink
          English
          arrow-up
          2
          ·
          24 days ago

          So this is just from the top of my head, there are several reddit threads about this.

          You can only bulk download in 5gb (maybe 50gb) chunks. With limited speed and unreliable connections (aborted downloads etc)

          Have you ever tried downloading a big size of your data? Never used it myself.

          • XNX@slrpnk.net
            link
            fedilink
            English
            arrow-up
            2
            ·
            edit-2
            24 days ago

            Oh i haven’t heard of that. I haven’t downloaded huge chunks no. I think you can connect with clients that allow pausing and continuing can’t you?

            You can also have a usb/harddrive shipped to you with your data to transfer everything quicker and its free if you ship the usb/harddrive back

            • ShortN0te@lemmy.ml
              link
              fedilink
              English
              arrow-up
              1
              ·
              24 days ago

              Nothing i am aware of, but as i said I never tried it myself. Let me know if you find something out.

      • ancoraunamoka@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        3
        ·
        25 days ago

        I mean… do the math and you can figure out by yourself that it’s a fair price but in no way some sort of very convebient situation for the users. A 20tb hard drive goes for about 450€ and then you can consider the advantages that they have buying hdd at scale.

      • lightnsfw@reddthat.com
        link
        fedilink
        English
        arrow-up
        4
        ·
        24 days ago

        I’d have to double check but I believe that only works on windows and I know for sure you can’t use it for network shares. I have it on my windows desktop but wasn’t able to backup my media server with it.

        • Arn_Thor@feddit.uk
          link
          fedilink
          English
          arrow-up
          2
          ·
          24 days ago

          Doesn’t work for network shares as far as I can tell. At least not without some funky magic

  • figjam@midwest.social
    link
    fedilink
    English
    arrow-up
    2
    ·
    24 days ago

    My library is not nearly as large as yours but I’ve got the things that i can get back over time like movies and shows and stls and I’ve got the things that i can’t get back cached elsewhere.