It's A Digital Disease!

11 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
326
 
 
The original post: /r/datahoarder by /u/PM_ME_UR_BOOOBSS on 2024-12-30 05:38:21.

First, if you clicked this and haven't heard of stash and would like to keep your more... sensitive... collections organized, its pretty neat and can be found here https://github.com/stashapp/stash. (I'm not affiliated with Stash, just use it everyday).

Second, if you are using Stash but haven't configured StashDB you're missing out. Don't be like me and accumulate about 8TB of videos and just find out about it. Information can be located here:

https://guidelines.stashdb.org/docs/faq_getting-started/stashdb/

In short, StashDB along with ThePornDB (and subsequently fansDB) make properly tagging and organizing your collection a breeze and much better than the normal community scrapers. It'll add associated performers, scene codes, tags, links to the scene, good scene covers, etc.

Properly tagged, dated, and linked scenes just warm my heart.

That is all. I'm sure quite a few people in the sub knew about that little addition, but if not, there ya go.

Edit: Follow-up tip. StashDB is good for professional scenes, but may cause some issues with improper tagging of some of your more amateur or semi-pro content. It's ok, ThePornDB references fansDB which scrapes from some of the more popular amateur stuff and does a pretty good job of recognizing some scenes.

Make sure you generate phashes before attempting to use these, as that's what the DBs use.

327
 
 
The original post: /r/datahoarder by /u/Career-Acceptable on 2024-12-30 01:35:32.

Not having a ton of luck trying to scrape some scenes I ripped off of DVDs with handbrake. Does it even work like that? Literally just set it up today.

328
 
 
The original post: /r/datahoarder by /u/onesixzoo on 2024-12-30 04:57:20.

I have a Samsung t7 2tb portable hard drive filled with movies.

My question is, which is better for hard drive longevity - is it better to copy a movie from the hard drive each time to my desktop and watch it from there, or just always play it off the hard drive?

I watch a couple of movies a night. Is it better to plug n play and absorb the 3 hours a day usage and wear and tear, or is it better to read and copy 2 movies (approx 2 Gb) a day? Which is better for the SSD lifespan?

Any help much appreciated.

329
 
 
The original post: /r/datahoarder by /u/Barastis on 2024-12-30 04:00:45.

Hello everyone!

I am considering upgrading my home server setup from an external HDD to a DAS.

I considered these: https://www.amazon.de/-/en/gp/product/B0DD3GSSCX

with a Seagate IronWolf 12TB Recertified (for start, then upgrade later).

My only question would be, what noise can I expect? I want to have this setup almost silent.

Any alternatives I am open to.

330
 
 
The original post: /r/datahoarder by /u/blackberriesandthink on 2024-12-30 04:00:06.

Lets say my NAS (DS620Sslim) has 40TB of data on it at capacity (6x 8TB in SHR1). It has 2 USB ports on the back.

Can I connect two external 20TB USB hard drives to it, and have Hyper Backup do a daily 20TB backup to one USB hard drive and another daily 20TB backup to the other USB hard drive?

I don't need the software to decide how to split the 40TB, I can do that manually if necessary by selecting the folders and the backup destinations.

Basically want to know if Hyper backup supports two USB hard drives at once,since my 40TB of data that needs to be backed up exceeds the 20TB maximum capacity USB hard drives I can buy.

Not interested in buying a second NAS for backup at this time.

If Hyper Backup can't do this is there any other software in DSM that can? Or maybe a better option/method?

331
 
 
The original post: /r/datahoarder by /u/altasking on 2024-12-30 03:17:37.

I have an Nvidia Shield I use for playing media on Plex. I do not connect to the Shield remotely. I simply use it to access my media locally and have no plans to use it remotely.

Currently I have a Seagate Expansion External HDD connected to the Shield. I need to increase my storage capacity and create redundancies. From what I’ve read so far, a DAS would be best for me…? Would you agree? If so, could you suggest any specific hardware? Would I just need a multi-bay HDD enclosure and some HDDs to fill it?

I appreciate any guidance…

332
 
 
The original post: /r/datahoarder by /u/stuff9414 on 2024-12-30 00:43:38.

Hi, I'm a student in a library tech program. After I had my preservation class I've become a little paranoid and started to look to build a disk (DVD l, BR, and CD) backing up machine. The goals is to digitize my disk collection. I had some parts lying around (the cpu, ram, psu, and case). Before I buy, appreciate someone looking over this. Would it work, or am I making an obvious mistake? Thanks in advance PCPartPicker Part List

| Type | Item | Price | |


|


|


| | CPU | AMD Ryzen 7 5700G 3.8 GHz 8-Core Processor | $159.00 @ Amazon | | Motherboard | Asus TUF GAMING B550-PLUS WIFI II ATX AM4 Motherboard | $149.99 @ Amazon | | Memory | Corsair Vengeance LPX 64 GB (2 x 32 GB) DDR4-3200 CL16 Memory | $89.99 @ Newegg | | Storage | Crucial P3 Plus 2 TB M.2-2280 PCIe 4.0 X4 NVME Solid State Drive | $117.00 @ iBUYPOWER | | Storage | [Seagate Exos X24 24 TB 3.5" 7200 RPM | | | Case | Fractal Design Define 7 ATX Mid Tower Case | $194.85 @ Newegg | | Power Supply | In Win P85 850 W 80+ Gold Certified Fully Modular ATX Power Supply | $150.00 @ Amazon | | | Prices include shipping, taxes, rebates, and discounts | | | | Total | $1290.82 | | | Generated by PCPartPicker 2024-12-29 19:45 EST-0500 | |

Edit: forgot to include the hard drive, Second edit: make it clearer that the goal is to digitize my disks

333
 
 
The original post: /r/datahoarder by /u/Q-Exclusive on 2024-12-29 23:58:58.

I've been searching for a while now and I can't find any that aren't older models that have a few units here or there. I don't need a ton of storage it's just gonna be for some pictures, video's and such so I don't want to have to buy 8TB+ HDD's. Any considerations?

I'm in the EU not the US for reference.

334
 
 
The original post: /r/datahoarder by /u/intellifone on 2024-12-29 23:09:52.

Hi Datahoarders,

I’m helping my mom and mother-in-law digitize their photo albums and import them into iCloud Photos. My mom is finished scanning and then decided to report the issue, my mother in law got partially through her project before noticing that all of the photos are now mixed into her regular icluod library, which has been fun considering holiday photos....They’re using photo scanners (Epson and Fujitsu models, both recommended by this subreddit), and while the scanning part is going smoothly, we’ve hit a roadblock with getting the correct photo dates into the metadata.

Here’s the workflow:

When they scan a photo, the scanner’s app asks for the date the photo was taken—great! But instead of saving that date to the photo’s metadata (like EXIF data), it just adds it to the file name. This is fine for sorting in folders but completely breaks when the photos are imported into iCloud Photos or Google Photos, which rely on EXIF metadata for date organization.

I know both iOS Photos and macOS Photos allow you to batch-adjust dates manually, but that’s tedious, especially since they’ve already gone through the effort of entering the correct dates during scanning.

What I’m looking for:

  1. User-friendly software that can work with their existing Epson and Fujitsu scanners and directly save the date as EXIF metadata during scanning.
  2. A post-scan solution that reads the date from the file name and automatically updates the EXIF metadata, but it needs to be simple enough for them to use on their own (no command-line tools).

I’ve explored some iOS and macOS apps and even tried creating an iOS Shortcut to process this automatically, but I’ve hit a wall—none seem to write the dates back to the EXIF metadata.

Has anyone solved this issue with easy-to-use software or tools? Ideally, I’d like something straightforward enough that I can set it up for them once, and they can handle the rest without much trouble.

Thanks in advance for your help!

335
 
 
The original post: /r/datahoarder by /u/StreetSquare6462 on 2024-12-29 22:25:50.

I'm looking to get myself a storage system with 2 drives. In a way that they are both synced, in case one fails. Do you all maybe have a suggestion?

Thanks in advance!

336
 
 
The original post: /r/datahoarder by /u/Huge-Dare-3302 on 2024-12-29 21:59:56.

Hello people,

I don't have much data, I also try to keep it from growing, but the data is slowly overtaking.

A desktop PC I use is outdated (although powerful enough for my needs), but I’m still unsure if I want a desktop (full-size or small form factor) or a laptop as my next machine. Also, I tend to feel that "modular" setup is more flexible in any of these two futures. So I believe it makes sense to have only working files (system, apps and projects) physically inside the PC, but all the synced mirrors, backups and not-so-important stuff should be outside.

The datasets are:

“Stuff”

2.1TB of not-so-important data (mostly videos, recorded live shows and movies), however, losing it will cause an unwanted inconvenience to me.

“Archive”

700GB of data that I can't afford to lose, updated rarely.

“Work”

35GB of data that I can't afford to lose too, must be highly available (in case of drive failures), updated frequently.

“System”

500GB of OS with apps.

How they are stored currently:

“Stuff”

single instance on 2x software-mirrored drives.

“Archive”

3 instances (synced folders), 2 of them on 2x software-mirrored drives.

“Work”

3 instances (synced folders), 2 of them on 2x software-mirrored drives.

“System”

just a single instance.

None of them has backups.

How I think it should be:

“Stuff”

single instance on RAID 1 (2 or more drives) or 2 or more instances on different drives. Just to lower chances of losing it. I think it doesn’t worth a backup.

“Archive”

2 or more instances (synced folders) on different drives, probably primary on RAID (if my setup will have one); must be backed up.

“Work”

2 or more instances (synced folders) on different drives, primary on SSD; must be backed up.

“System”

images must be taken.

Required storage:

For “Stuff” it could be NAS with at least two 4TB drives in RAID 1, or a DAS, or just a bunch of external single HDDs. Here I’m just completely lost on what’s the best option.

“Archive” could also reside on the same storage as a primary location, then duplicated (synced) to other (usual external HDDs).

NAS is the most expensive and seems to have too many features I don’t need. I just want to use it as an external storage with an out-of-the-box RAID. On the other side, it’s the only option which allows connecting from/to multiple computers (e.g. laptop and desktop) without physically plugging the cable around. This also helps with laptop because you just reuse the same WiFi (auto)connection you already always use for Internet.

DAS seems super easy and straightforward, but it’s less flexible, isn’t it? And am I right that only few models support built-in RAID?

Or maybe just a bunch of single external HDDs (like WD MyBook) with simple copying/syncing to them? I don’t like external drives because of their strange power management features, e.g. it turns off, but later, when I want to quickly access something (even on the other drive), it suddenly spins up. On top of that, drives spin up one after another instead of simultaneous spin up (WD MyBook Duo). I want an external drive to be functionally as close to the usual internal drives as possible.

“Work” and “System” will live on SSD-s, “Work” will be synced to at least one more drive.

Not clear what storage should be used for backups. Also a NAS if I choose one as a primary storage or it must be external HDDs? In either case, mirrored or single?

Backup system:

I don’t know what’s the best way to do backups and system images. Full vs differential vs incremental. Will figure it out hopefully. Also, it’s not clear what software is the best. I think it should be one of the paid options as it implies it is more reliable.

The question:

I’m sorry if the “question” is too big, but I’m completely lost here. I’m afraid to invest in something that will be suboptimal, overcomplicated, unconvenient etc. On the other hand, I’m more concerned of having too unsecure and unreliable setup. What do you guys think? Is the idea of storing the data externally? What kinds (and quantities) of storage would you choose?

EDIT:

I don't trust software mirroring because currently software-mirrored disks in Windows are “Resyncing” too often. Doesn't look like something good.

337
 
 
The original post: /r/datahoarder by /u/falconinthedive79 on 2024-12-29 21:12:11.

Hello, I am trying to find an app or site that I can just post a link to a facebook album and it parses and downloads the album. I saw something in this group from four years ago but all the links don't work anymore. Any help would be appreciated, preferably free!

338
 
 
The original post: /r/datahoarder by /u/stfucomm1e on 2024-12-29 21:06:06.

I am beginner in this data hoarding stuff and I started with a 2TB Kingston NV2 SSD in a uGreen USB 3 enclosure, which I use to store my torrents. I am planning to go full on NVME SSDs because I am constantly moving from a place to another. NVME's are more portable and have less risk of damaging as they don't have any moving parts like HDDs.

That said, my enclosure works for a few minutes or hours. Then I notice it stopped working, the file explorer starts to hang and will only unhang when I unplug the enclosure. I suspect the issue is with the enclosure, so I am looking for a new one, I was considering the Anker's fan cooled enclosure or buy a NAS dedicated for NVME's.

339
 
 
The original post: /r/datahoarder by /u/ZoteTheMitey on 2024-12-29 21:02:29.
340
 
 
The original post: /r/datahoarder by /u/BenX855 on 2024-12-29 20:53:09.
341
 
 
The original post: /r/datahoarder by /u/ZoJaBeatz on 2024-12-29 20:37:06.
342
 
 
The original post: /r/datahoarder by /u/FriedCheese06 on 2024-12-29 20:03:56.
343
 
 
The original post: /r/datahoarder by /u/Canesh on 2024-12-29 19:39:13.

Hello,I have a homelab with pfsense, proxmox, truenas, ubiquity, cisco, and synology. Currently, my truenas is shut down with 6x16 TB seagate exos drives. My synology is a DS1817+ with 8x10 TB Seagate Ironwolf drives in SHR-2. The Synology is currently 77% full with 40.2 TB stored (total capacity of 54.5 TB).

In an effort to save on the electric bill, I am decommissioning the truenas. I also have a 12 tb seagate Ironwolf drive as a cold spare.

I'm thinking of doing the following:

Swap 7 of the 8 drives in my Synology from the 10 tb capacity, to the 12 or 16 tb capacity.

However this would be a resilver of a total of 7 times plus one more to expand.

That being said, I would like to know if this is something I should do.

SMART on all drives is good. One of the 10 tb drives has 8 bad sectors, but is otherwise healthy.

Also with SHR-2, I need to replace a minimum of 4 drives to see any increase in storage.

The truenas was the biggest culprit in the electric bill running two intel Xeon e5-2650 v3 processors and 320 gb ecc ram.

The second biggest energy hogs were the proxmox boxes running on a pair of lenovo thinkstation c30's each with two intel xeon e5-2620 v2's in them and 64 gb of ecc ram in each.

The question I have is should I increase my storage on the synology, and if so, should I offload the data and swap all drives at once? Or should I keep the data in one place as I resilver the drives 7-8 times?

I have a friend who might be willing to host my data temporarily, however, his availability is limited to 12x 3tb drives, which means, even if he runs RAID 5, that I have roughly 10 TB too much data for that, and will need to delete some.

Currently my budget is $0 and to use what I have first.

What would you do?

344
 
 
The original post: /r/datahoarder by /u/randopop21 on 2024-12-29 19:00:13.

I have a couple of older HP corporate desktops ( HP 800 SFF Gen 1 desktops) that have an option in the BIOS to enable RAID, which I'm going to assume is only RAID1 given that there are only 3 SATA connectors on the motherboard.

In the past, I've had good luck with Intel motherboard RAID1 (on a Supermicro Xeon motherboard) but that was 12 years ago*.

The nice thing about motherboard RAID is that I don't have to learn anything new. To Windows, it's just a (single) hard drive. While it's on my wishlist to learn Linux and mess around with things such as unRAID, I don't want to experience a problem and not know what to do.

I'm not after high-performance. Just reliability since I plan to use refurbished 20TB drives from the usual sources that this sub recommends.

This is a home situation. I'm the only user.

Would you use motherboard RAID1 in 2024? What are the downsides?

(*) That Supermicro motherboard is actually still in use, 12 years straight, Windows Server 2012 R2, 3 separate RAID1 arrays of 256GB SSDs.

345
 
 
The original post: /r/datahoarder by /u/TheFlyingCelt on 2024-12-29 18:57:52.

Hi guys,

since version 7.0.0.20 and once I reboot my PC, IDrive backup software is not scanning for new files and not backing up anymore. I had to go back to v7.0.0.19 for it to work properly. As of today 29th, dec. 2024 they released v7.0.023 but still I'm experiencing the same issue and I'm wondering if anybody out there has noticed that too as I'm not sure if it's just me, or if - as usual - IDrive broke their own software.

Thanks

346
 
 
The original post: /r/datahoarder by /u/babyshinj1 on 2024-12-29 18:08:40.

Hey guys!

I just stumbled upon this subreddit and was pleasantly surprised to find a community of people like me who love storing data!

I was once a victim of the cloud’s “easy” way of storing data—until I realized how pointless and unreliable it can be. I’m paying €10 a month for 2TB! Pretty good, right? Until you consider that if I stop paying, all my data could disappear.

My main storage needs include iCloud backups (for my phone and Mac), some documents, and a huge collection of photos taken with my vintage digital camera. Ideally, I’d like to access these files from anywhere so I can share them with others. But that’s not really the main goal—I just want a reliable and comfortable way to store all my documents!

I’m thinking of setting up a double archive system with copies of my data on two different formats.

1 SSD and 1 HDD with the same format, what do you think?

347
 
 
The original post: /r/datahoarder by /u/Mlitz on 2024-12-29 17:21:38.

I have become a forever seeder and it feels really good to give back to the community but have never ventured into the Internet Archive until I found some old documents that I don't want to be forgotten someday. A lot of torrents that I started to seed seem to be dead so I am downloading the zip and adding the files to the torrent so they can be revived. I am going to spend a few thousand dollars on some more of these documents if I can't find them so I can digitize them and keep them around I want to thank you for all of this community's hard work that is unseen and enjoyed by us. It's not glorious to the everyday person but we do the work non the less.

348
 
 
The original post: /r/datahoarder by /u/ScaredAd9444 on 2024-12-29 09:29:25.

Im new to trying out web scraping but was wondering how I could scrape images that are stored as a "2.bp.blogspot.com" in the actual source of the website

349
 
 
The original post: /r/datahoarder by /u/djslakor on 2024-12-29 18:59:39.

I've noticed this on both a 12TB and 16TB version of the external WD Elements.

I set windows to not power off the drives since it tends to do so far too quickly, and the constant spin up likely puts too much wear and tear on the drives. I've heard it's better to just keep them running.

I've noticed if I leave the drives running for a day or two, they exhibit an intermittent humming sound that lasts 1-2s and occurs once or twice a minute.

I assume it's not a drive defect since I observe it in multiple drives under the same conditions.

Anyone else notice that? Is it something to be concerned about, or just normal operation?

350
 
 
The original post: /r/datahoarder by /u/Mundane-Shock5218 on 2024-12-29 18:00:03.
view more: ‹ prev next ›