this post was submitted on 06 Oct 2024
54 points (96.6% liked)

Asklemmy

43604 readers
1258 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy πŸ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
 

Most people realize too late that they didn't have backups of their data or don't realize they can easily setup their own media servers at home. What do you use and suggest? Everything from beginner tech knowledge to advance. TIA

top 38 comments
sorted by: hot top controversial new old
[–] [email protected] 12 points 1 week ago

I have my important folders synced to my nextcloud and do nightly backups of that using borg.

[–] [email protected] 11 points 1 week ago (2 children)

I use Backblaze for all offsite backups

[–] [email protected] 3 points 1 week ago

same here

Local I have trueNAS raid Z2 for photos/docs/home dirs/etc (backed up to backblase) and a zfs mirror for music/movies/etc not backed up

[–] [email protected] 2 points 1 week ago

Same for me, Backblaze is the shit

[–] [email protected] 10 points 1 week ago (1 children)

There is no one size fits all for how someone should do their backups, it really depends on what you have and how much. What do I have? Over 100TB on a redundant unrais server with it backed up off-site. That's probably overkill though. Most people would just benefit from an external hard drive with automated backups set up.

If you want to know it's safe, the go to solution is 3-2-1. 3 total copies of your data across 2 different types of data storage, with one of them off site. That's the only way to truly know your data is safe.

[–] [email protected] 4 points 1 week ago (1 children)

Are there certain brands of external hard drives you recommend for local backup?

[–] [email protected] 6 points 1 week ago (1 children)

The WD elements drives are pretty rock solid. The drives themselves are WD reds inside, which are very reliable. The only iffy thing is if the control board (the device that converts USB to the internal drive) can fail, but that's true for any external. It's my go-to backup solution.

[–] [email protected] 1 points 1 week ago

theyre the drives i buy and shuck. Love me WD reds.

[–] [email protected] 8 points 1 week ago (1 children)

Personally I never reached a point where I had to use any kind of storage software. All you need is a good external storage and a little bit of organization.

If anyone is serious about data storage I would honestly choose external SSDs or an enclosure that supports SSDs. I've had terrible experiences with hard drives failing over the years or clicking and corrupting my data.

[–] [email protected] -1 points 1 week ago

Where do you put your SSDs, though? If it's not off-site, it's not a backup.

[–] [email protected] 5 points 1 week ago (1 children)

I have a Nas running nextcloud for general ease of automatically backing up anything important from my phone or pc.

Nextcloud and important things from the server are backed up using a tool called "restic" which honestly does not get enough mention here.

Restic is amazing, it supports just about every cloud storage provider out there - could be Amazon S3 or backblaze, but it could also be OneDrive or Google drive. If you've got some cloud storage somewhere, restic will probably support it.

Restic is super clever, it takes snapshots and only backs up any data that has changed - so it's very space efficient and fast. I back up hourly, it only takes a few mins and if nothing has changed, there cost is also basically nothing. But you can pull back files from any snapshots you keep and when you delete a snapshot, it only deletes data that's not used by any snapshot.

This means you can have backups going back months or years at very little data cost. You can restore a full backup, or just a specific file if you need.

Seriously, restic is amazing and more people need to know about it.

[–] [email protected] 2 points 1 week ago (1 children)

I'll have to check it out. Restic sounds interesting.

[–] [email protected] 3 points 1 week ago

Definitely do! It's entirely command line driven, but don't let that put you off, it's quite easy to use and well thought out.

If that's still a concern, there's also backrest, a project that puts a web UI in front of restic:

https://github.com/garethgeorge/backrest

[–] [email protected] 5 points 1 week ago (1 children)

Follow the 3-2-1 rule for all data you would be upset to lose. Having a server (really just any networked computer that can receive and store enough data) is the easiest way to accomplish "1" and "2". Then encrypt and send that data offsite to either another server you maintain or to the cloud.

[–] [email protected] 3 points 1 week ago (1 children)

Is there a cloud service you recommend?

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

I recommend treating the cloud service as just a file host for one or more encrypted backup files/directories. If you do that, then you can use a huge range of hosts without worry.

A nice option is ab S3-compatible host. Whatever is reasonably cheap and well-liked. These hosts often allow you to keep two or more "versions" of your backups at free or reduced storage prices, which is a pretty great layer of added redundancy. They are also compatible with a ton of software tools.

I avoid listing the ones I personally use (I actually do 2 offsite copies) for infosec reasons.

[–] [email protected] 4 points 1 week ago

I use Onedrive for storing files offsite, and a Synology NAS for onsite. I've got my PC as the main source of my files, and use Syncthing to sync to my laptop and NAS, and Onedrive syncing the PC and NAS to the cloud.

I know Onedrive isn't always popular here, but it does everything I need, and is cheap. It also lets me access my files from my phone

[–] [email protected] 4 points 1 week ago
  • Pictures: On a folder on a server I syncthing to. I don't really look at them. I used to have NextCloud for browsing them, but it was slow. I might give Immich a try
  • Music: Youtube and the songs in my head. Sad, but it's true. I have a large collection I rarely look at. I also have a rockbox I sometimes pick up and play to rejig my tastes.
  • Movies/Tv shows: Kimcartoon was main goto for cartoons, but it's down now. I use other sites. Movies, usually I find some recommendation on Lemmy and then I go find a nice DCC on an irc server somewhere with irssi. I had JellyFin for a bit, but I just don't watch movies or series that often.
  • Backups: Some in the cloud. Rest in a big old hard drive. Plug it in once a year, update and tidy it up. Power down, back into cold storage.
[–] [email protected] 3 points 1 week ago

I’m all about keeping it simple with a NAS drive at home and cloud backups for that extra peace of mind. Having a local copy is great in case of internet issues, but the cloud is there for when disaster strikes. A mix like that gives you flexibility and quick access for your media needs!

[–] [email protected] 3 points 1 week ago (1 children)

Hard copy.

Photos in a photo album, documents in a filing cabinet.

[–] [email protected] 6 points 1 week ago* (last edited 1 week ago) (1 children)

Okay but like what if your house burns down
It's good to have some kind of backup for worst case scenarios

Otherwise I totally agree. I feel like the only way I'll actually look at my photos is if they're physically there for me to see.

[–] [email protected] 5 points 1 week ago (1 children)

This is why I'm scanning in all my old physical photos. It's great to go through the originals, but if anything was to happen, they'd be gone forever.

[–] [email protected] 1 points 1 week ago (1 children)
[–] [email protected] 2 points 1 week ago

It's an Epson Stylus, 235w I think. I'm not home to check at the moment. It's not amazing, but it scans at up to either 1200 or 2400 dpi, and I usually use 600 dpi, as that's more than enough for the typically low quality photos I've got.

I'm sticking with it on Windows for now too, as the software can do some corrections with one click, like certain colour corrections. I've tried a few Linux packages, and while they're good, they're all missing something compared to the Epson Windows software.

[–] [email protected] 2 points 1 week ago

SMB file share, nightly backup for files, monthly backup for entertainment media, both to a RAID 1 18TB backup mount. Important docs also copied to a flash drive that I keep at an off site location, and swap about once a month.

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

Photos are stored in iCloud but originals of every photo is kept on both my iPhone and Mac. Plex library, it is stored with Unraid Parity, and additionally I’ve got all the magnet links in one spreadsheet.

Edit: oh no, downvote! Why?

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago) (1 children)

ATM
Most of the files are local to my PC
Backed by Veeam to an SMB share.

Anything else like videos, music etc. are on my media server

[–] [email protected] 3 points 1 week ago (1 children)
[–] [email protected] 1 points 1 week ago

Double Parity is enough of an backup for files that are not important.
Reason why vacation pics are on my IP >_>

[–] [email protected] 2 points 1 week ago (1 children)

Local files, s3 sync on a 5 minute scheduled task to a glacier flexible retrieval bucket with versioning. Then I have an s3 sync app on my phone to make it all work like dropbox.

[–] [email protected] 1 points 1 week ago (1 children)

What's the s3 app for your phone?

[–] [email protected] 2 points 1 week ago
[–] [email protected] 2 points 1 week ago

I've got a beginner 2 bay NAS set up with about 18TB for all my family's media.

Pictures from our phones are also backed up in Google Photos. Not private at all but it works as an off site option.

[–] [email protected] 2 points 1 week ago (1 children)

OWC Express 4M2 with four 8TB m.2 chips raided for 24TB of lightning fast storage for media. And a Synology DS1522+ with expansion bay for 96TB of storage for backups plus more media (plex library to stream to home theater). Additional backups to 8TB SSDs for the builtin storage of my main machine. This is somewhat excessive, not what I recommend for most users, but definitely right for my use.

Everyone should have minimum two backups. Ideally three with one of them being offsite in case of disaster such as fire.

[–] [email protected] 3 points 1 week ago

Offsite backup is not optional for anything important. It's worth paying for AWS or literally any other online storage solution for that copy. You don't want a natural disaster to lead to the loss of all your life's photos for example.

I also personally don't recommend doing your own software for anything related to backups, you can't test edge cases easily and it could easily lead to loss of data. I once used an app that attempted to manage its own backups delete it's online backup when it lost its local data as it attempted to back up the blank local data.

[–] [email protected] 2 points 1 week ago* (last edited 1 week ago)

My home server has an NVMe that has the OS and all the Docker Compose stacks and their database data. The big data (photos, movies, backups, etc) are on a big 6 drive RAID 6 array. The NVMe gets backed up to the RAID every night. They go into folders named after the day of the week, so I’ve always got 7 days worth. Then every week or so, I rsync the whole RAID to a big drive at my parent’s house. The reason I do that manually is because I don’t want it happening if I get hit with a ransomware attack.

That was all relatively easy to set up, but server administration is also my profession, so for normal people, I recommend an easier home server setup and a commercial backup solution.

I’m actually working on an open source backup solution based on my deduplicating WebDAV server, Nephele. If I can pull it off, it’ll be free and open source to run on your own hardware, or you can pay my company to back up to my hardware.

[–] [email protected] 2 points 1 week ago

My setup is simple:

  • Pictures: I don't take many and rarely look at them tbh. So they just sit on my laptops NVMe
  • Music: I only ever use cmus for listening to music => Therefore music is also only locally on my laptop, managed with beets
  • Movies/Tv Shows: I have jellyfin running on a raspberry Pi 4. For single user use this works fine (even transcoding DVD quality works). For multi user or higher resolution transcoding this probably won't work.
  • Backups: One off-site backup at a cloud storage provider using restic and one backup on a USB hdd I simply plug in every other week.

My recommendation is: Keep it as simple as possible. In the past I created the craziest setups, but it turns out that in every day life I have neither the time nor motivation to maintain that shit.

[–] [email protected] 1 points 1 week ago

I have a BackBlaze B2 cloud cold storage where I back up everything from my entire family. If they have a computer, I back it up, fully encrypted, via Duplicati. Not the best option for a machine-side client, but I like it and it’s been reliable for me.

As for on-site storage, I have a pair of 4U rack mount cases with 24 hot swap bays in the front. Once I have my server room configured and cooling correctly, it will be the local backup site for everything in-house, and likely serving other duties as well.