It's A Digital Disease!

11 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
576
 
 
The original post: /r/datahoarder by /u/Xiiira on 2024-12-23 02:30:10.

Hey

I just moved into the apple ecosystem and I'm trying to transfer my 500GB of datas from Google Drive to iCloud.

Anyone have any clues on how to do that painlessly ?

I'm trying MultCloud atm but it's not working like a charm, lol, thank you.

Sorry for English mistakes, Frenchie here.

577
 
 
The original post: /r/datahoarder by /u/S-W-I-S-S-M-A-N-N on 2024-12-22 09:52:17.

Hey Community, I have an Plex server with around 16TB of Series and Movies and play with my mind to use Mega Cloud as Online Backup and Storrage. Did you think this was an good ideal for an Backup solution ?

Thanks for help

578
 
 
The original post: /r/datahoarder by /u/VegetableNo1487 on 2024-12-22 04:57:23.

I am using a program called alldup, it finds duplicate files on your pc so you can delete them. I am just not sure if the results display all the files with the same name (even the originals). If I select all the results and delete them will I lose the original? Thanks in advance?

579
 
 
The original post: /r/datahoarder by /u/apatheticonion on 2024-12-22 04:10:06.

When I calculate the cost of 1 8tb HDD (excluding the cost of the PC & internet), a 5 year lifespan using 10w of electricity - I can expect to pay $7/m to self host.

Are there any cloud storage providers that are a decent alternative for around the same price?

I don't need redundancy, enterprise reliability or anything fancy. Would likely connect it to Plex via rclone or similar FUSE mount

Mega.nz is ~$17/m AWS S3 is $50/m Google Drive is ~$70/m ($26/m for 5TB)

580
 
 
The original post: /r/datahoarder by /u/No_Trust_8596 on 2024-12-22 03:58:54.

I'd like to delete my Whatsapp account so that no one can message me there, for privacy reasons (don't like Meta getting my metadata). BUT don't want this to be irreversible. I have an iPhone. And I lack the technical savvy to switch to Android and perform backflips to export my chats and media in a readable format. So: I want to save a Whatsapp backup on iCloud, then delete my Whatsapp account, but retain the backup. I get the impression that if I delete my WhatsApp account, the iCloud backup disappears too. (And if I just delete the app, people will still message me; I'd rather they not be able to find me at all.)

Is there a way to save the Whatsapp backup from iCloud, so that when I delete Whatsapp, I retain the backup, and if I ever want to reactivate Whatsapp (with the same phone number), I can get these chats restored in the native Whatsapp chat history?

581
 
 
The original post: /r/datahoarder by /u/mmarshman88 on 2024-12-23 03:15:20.

Hey Homelabbers,

I am looking to rebuild my Jonsbo N2 NAS with a couple minor improvements. The main issue I’m facing is a slowly increasing ATA error count for a system that was built less than 2 years ago. I’m suspicious of the SATA port expansion card I’m using as the cause, but a little out of my depths in trying to understand the failures. I also have a decommissioned Hackintosh PC which has a GPU I’m considering integrating into the rebuild.

While rebuilding, I’d like to improve airflow in the entire case to help drive temps. Additionally wouldn’t mind incorporating the graphics card from my decommissioned Hackintosh for improved overhead of the Jellyfin instance to expand the user base to a couple more family members, or buy a graphics card that will improve upon the built in graphics of the CPU without being overly expensive. I also would like to consider virtualizing or migrating the services I run on a Dell Optiplex Micro i5 w/ 16gb ram which runs Home Assistant and a handful of LXCs and VMs into the same server, as the server itself is overbuilt for its current usage and the Optiplex occasionally grounds to a halt when I give it a large influx or data to process -though overall, it might be better off remaining on a separate device for the sake of separation.

Services I run on the NAS: Jellyfin, kasm, pyload-ng, sabnzbd, and an instance of ollama that doesn’t get much love.

Services/VMs I run through Proxmox on the dinky little Optiplex: Home Assistant w/ Frigate and a Coral for image recognition ingesting streams from 4 PoE cameras (ideally part or all of this moves to the NAS’s NVME as the cameras will be constantly writing), *arrs x2 (shared instance, and a non-shared 4k), Immich, Paperless, AdGuard, Vaultwarden, ChangeDetection, Hoarder, Jellyseerr, 2 super small alpine VMs, and a handful of other services not worth mentioning.

Questions for the homelabbers out there:

  1. My cursory understanding is ATA errors are an early sign of drive failure, but in my case I’m suspicious of the cables and expansion connection 2 of the drives are connected to vs the actual drives. What should I do about the slowly rising error count…? Should I replace drives after fixing the underlying issue…?
  2. Should I use a different case for better airflow? Ideally it would fit within 17” x 14” x 12” to fit in my rack -I don’t really have anywhere else I can put it where the noise won’t drive someone in the house crazy.
  3. Are there any better mobos now that support AM4, and my need for 7 drives without the use of a SATA expansion card while being a small-ish board?

The NAS has:

| Part | Model | |


|


| | OS | TrueNAS Scale | | Case | JONSBO N2 | | CPU | Ryzen Pro 5650GE | | CPU Cooler | Noctua NH-L9a | | Mobo | ASUS ROG Strix B550-I Gaming | | Ram | 2x Kingston Server Premier 32 GB 3200MHz DDR4 ECC | | RAIDz2 Storage Drives | 5x Western Digital 16TB WD Red Pro NAS Internal Hard Drive HDD - 7200 RPM | | Apps/Docker Drive | 1x WD_BLACK 1TB SN770 NVMe Internal Gaming SSD Solid State Drive | | Boot Drive | 1x Kingston 240GB A400 SATA 3 2.5” Internal SSD | | PSU | BN639 SFX L Power 600W | | Port Expansion | IO CREST M.2 B+M Key to SATA III 2 Ports Expansion Card Jmicro JMB582 Chipset, Add Two SATA 3.0 Devices to Any M.2 2242 Slot SI-ADA40149IO CREST M.2 B+M Key to SATA III 2 Ports Expansion Card Jmicro JMB582 Chipset, Add Two SATA 3.0 Devices to Any M.2 2242 Slot SI-ADA40149 | | Sata Cables | ADCAUDX SATA-III Cable:0.5M 6Pcs/Set-SATA Cable 90-Degree Right-Angle SATA-Data Cable SAS/SATA-6Gbps Cable |

The decommissioned PC that’s just laying around has:

| Part | Model | |


|


| | Case | NCASE M1 | | CPU | i7-9700 | | CPU Cooler | Noctua NH-C14 | | Mobo | ASRock Z390 Mini ITX | | Ram | 2x16gb DDR4 3200 | | Drives | 2x Samsung 970 Evo Plus 1 TB NVME | | Graphics Card | PowerColor Red Dragon RX 5700 XT 8 GB | | PSU | Corsair SF600 |

582
 
 
The original post: /r/datahoarder by /u/Longjumping_Tax3639 on 2024-12-23 02:40:44.

I have two 20TB external HHDs from Seagate that I haven’t unboxed yet. I want to store newly downloaded movies and TV shows on one, with the other acting as a redundancy. I plan to use ZFS for organizing and preventing bit rot. They’ll be connected to Plex for streaming.

Since ZFS comes with a built-in mirror program, I’m not sure how to proceed. I’ve read a lot about mirroring and the different Raidz options, but I’m honestly on the fence about which one is more appropriate for my small at-home setup.

My interest is data integrity and protection over expediency and performance. I’ve read that mirroring drives this large may be dangerous, though that was a single comment on a Truenas forum.

What do you recommend for keeping my hoard best protected for long-term use, with 2 drives? Thank you in advance.

583
 
 
The original post: /r/datahoarder by /u/Dark_Kayder on 2024-12-23 00:35:21.

First, because I may just be dumb and haven't figured it out. Is there a way to view Reddit posts in the Wayback Machine when it asks for a login? Clearly, the person archiving was logged in and viewing the post, and they just tried to save it through the url without checking if it was viewable afterwards... But in case it's not possible, where can we publicly archive NSFW and other login-required all-text Reddit posts in a way that they will be available in a usable way in the future?

584
 
 
The original post: /r/datahoarder by /u/gopher962 on 2024-12-23 00:06:43.

Hey all,

Maybe a dumb question but I can't stop wondering why there isn't a cheap alternative to AWS Glacier Deep Archive. Please don't say "buy your own disk" as I am talking about businesses who aren't interested in having a physical disk in an office or maintaining it, yet still having to park large amounts of data for long periods of time.

For example, I know that many companies store data in Glacier only because of legal reasons and don't really access this data at all. It's typically only there and stored, if ever one day authorities request access. For example, logs related to PCI and HIPAA fall into this category. Or any other auditing logs, or legacy assets of companies.

The Glacier Deep Archive service costs around 1$ per TB (depending on the region), excluding the data transfer costs. If I store 16 TB there, it will be 16$ per month = and 192$/year (+tax and data transfer).

For 240$, which is almost the yearly cost of storing this data, I can easily buy a 16TB disk.

Just imagine buying two of these disks, and placing them in two different geographical locations for redundancy reasons. Whenever a disk gets full, it can also be powered off to save electricity cost as the service won't promise rapid retrival of data. If a customer needs to retrieve data, it can be powered on again in 12 hours for example.

The profit marging of such service seems potentially quite high to me.

But what am I missing? :)

Thanks

585
 
 
The original post: /r/datahoarder by /u/pulimento on 2024-12-22 23:50:08.

Found it on Amazon for about $400: N100, 8Gb RAM, 4bays: https://amzn.eu/d/faRvBjl

Do you think this is a good deal?

  • Usage: Photo family backup. As an alternative to existing external HDD backups.
  • Probably powered off most of the time. Will automate with Home Assistant to do a proper shutdown
  • Will use TrueNAS
  • Emphasis on smallest form factor
  • Exactly 4 bays
586
 
 
The original post: /r/datahoarder by /u/wiener_dawg on 2024-12-22 22:37:02.
587
 
 
The original post: /r/datahoarder by /u/gpmidi on 2024-12-22 22:27:39.

As a user/owner of a few Quantum Scalar i6000 tape libraries I need to use 700Q series or later firmware since I have LTO8 drives in a few. The three I have are a mix of gen1 and gen2 robotics with 726 LTO slots and up to 12 drives each.

The 800 series firmware introduced a call-home system for validating that a library has a valid service contract in order for it to function in any real way. While there are other solutions like using a different serial number, the easiest is a @reboot cron job to update the postgres based license table saying the service license is valid.

Details: https://www.gpmidi.net/node/200

588
 
 
The original post: /r/datahoarder by /u/Billm189 on 2024-12-22 21:53:34.

I have the Sandisk G-raid drive. I want to access the whole 24tb with no backup (and backup physically with another one) but no matter what I try I cant seem to unraid it. Does anyone know how I can access the full 24TB and not be stuck with 12TB? Thanks

589
 
 
The original post: /r/datahoarder by /u/snowstussy on 2024-12-22 21:40:57.

Where does one buy refurbished enterprise hdd's in Europe (Belgium). I am looking for something in the 12-16TB range. Also, what's your experience with these refurbished hdd's?

590
 
 
The original post: /r/datahoarder by /u/ShareGoodBeer on 2024-12-22 20:19:56.

I plan to rip my movie collection to a NAS, which I have not purchased yet, but did buy six 22TB WD Pro Red HDD's over their Black Friday sale. Someone suggested I surface test each of the HDD's while I await purchasing my NAS in case there are any problems and they need to be replaced.

He suggested using HD Tune for software, and a two slot docking station with fan for the scans. Can anyone help direct me to good options for this? I think I have found examples of the docking stations for this, but I'm not 100% sure, and I have not found any with fans, so wanted to ask those more knowledgeable than I. If anyone has any other suggestions for software programs for that besides/better than HD Tune, I'd welcome that as well. Thank you!

591
 
 
The original post: /r/datahoarder by /u/EDACerton on 2024-12-22 20:15:38.

One of my friends is a technical writer/editor, but the company that they work for will go bankrupt very soon. All of their work is on a web site, and they expect that the web site will disappear when the business collapses (taking their portfolio of work with it).

They asked me to scrape/archive the site so that they would have a copy of their work. I’m trying httrack, but getting poor results due to JavaScript, etc.

Does anyone know of any tools that could scrape all of their pages to something like PDFs?

592
 
 
The original post: /r/datahoarder by /u/Prior-Call-5571 on 2024-12-22 17:44:59.

Currently I run Proxmox on an optiplex 3010. It runs well, I just have a Windows server DC Desktop edition and 2 Linux servers

On the linux server though, I am beginning to want to run a NFS I can access remotely. I have the Server Samba share running, but this entire build is currently running off of a PNY CS900.

Im looking to upgrade because Im limited to 16GB of Ram currently, and I also have read I may be more bottlenecked from better storage due to my Mobo.

looking at an Optiplex 7070 for 250$ right now

Just wanted Datahorder opinions on the type of low spend build I would be looking at. Should I just buy a DAS? Is there some insane benefit to buying a budget gaming PC? Currently my mentality is as long as I can have the Ram I need, and good storage, nothing else tends to be on my radar.

593
 
 
The original post: /r/datahoarder by /u/The-Count-1998 on 2024-12-22 15:15:13.

I need a storage of 1TB. I have 2 options in my budget to a external hdd or to buy a internal ssd NVMe gen 4 then covert it into external by buying a case. Which one will be better as both are in my budget. Note: in my current pc set up motherboard don't have NVMe gen 4 port but in future I may upgrade my pc.

594
 
 
The original post: /r/datahoarder by /u/steevjp on 2024-12-22 12:53:26.

I am on a mission to organise my music on my machine (windows 11). Over the years I seem to have 4 or 5 places over 3 hard drive where I have saved files, both in MP3 and FLAC format. There is a lot of duplication here. Most of my music is organised in an itunes folder when I used to use itunes (I don’t anymore) and then I have some of my CD and purchased downloads in FLAC format.

 Looking for recommendations for decent windows based software to organise this library into one place so I delete all the duplicates I have.

I found this https://www.reddit.com/r/DataHoarder/comments/15tm8nl/software_recommendations_to_organize_music_library/ - post from a year back and there is a lot of mention of tags, I am a total newbie to this so not sure how/if tags are important and should I care? From that post MusicBrainzPicard stood out to me but not sure if that is still a decent package or if there is something else on the market?

 Thanks in advance

595
 
 
The original post: /r/datahoarder by /u/OniHanz on 2024-12-22 10:11:15.

Hey everyone,

I’m working on a storage/backup project spanning two different sites, and I’d love your input or suggestions. Here’s a quick rundown:

Site 1 (Main Storage) • 8×20 TB in RAID6 (~110 TB usable). • Acts as the primary storage with redundancy for up to two disk failures.

Site 2 (Backup) • 6×16 TB + 2×8 TB (about ~112 TB total). • No RAID here; I’m planning to use MergerFS to unify the storage pool.

The Plan

1.  Automated Transfers: I want to use Ansible to automate data synchronization from Site 1 to Site 2. (Likely using rsync or rclone for incremental copies.)

2.  Data Indexing: Because Site 2 has no RAID, I’m setting up an index to track which disk holds which files. That way, if a disk fails, I’ll know exactly what data was on it.

What do you think about this approach? Any suggestions for improvement?

Thanks in advance for your insights!

596
 
 
The original post: /r/datahoarder by /u/chrisnorcras on 2024-12-22 06:34:05.

Hello everyone!

Working on building a NAS and bought brand new Seagate 8TB Ironwolfs to start the process. Wanted to go ahead and get some additional storage, but didn't have the funds to buy additional full-priced drives, so I thought I would try these on Amazon from goHardDrive. For $79.99, I wouldn't mind getting some 3 year old used drives, even if the hour count was a little high.

Unfortunately, that was not the case. When I ran "Short" S.M.A.R.T. tests on the drives, it became immediately clear that the average drive use time was actually 7+ years... 65k+ hours on three of the four drives. The other drive was either almost brand new, or has had the S.M.A.R.T. data erased. I'm running "Long" tests on them now, to see if any more information is revealed.

In addition to this major gaff, they also sent me a different drives (604's instead of 601's) than what I ordered.

I reached out to their customer support via Amazon and they replied saying that Amazon hadn't updated their listing and they would give me a $10 refund on each of the four drives I purchased. Still, I'm curious as to how the usage time went from 3 years to 6+ years, unless they've been using the drives in the interim...

Just something to be aware of when purchasing from them.

SMART Tests and Customer Service Message: https://imgur.com/a/JBNauws

597
 
 
The original post: /r/datahoarder by /u/Nat_Wilson_1342 on 2024-12-22 05:25:00.

Has anyone here tried something like that ?

Can modern AES en/decription engine keep up with aggregate bandwidth of say 5 PCIe4 stick in such RAID and at what CPU load ? 🙄

598
 
 
The original post: /r/datahoarder by /u/mdragnev on 2024-12-22 18:30:04.
599
 
 
The original post: /r/datahoarder by /u/uvuguy on 2024-12-22 18:24:11.

I love storage, not sure why but buying and setting up storage has become somewhat of a problem.

My wife thinks the problem is I keep buying more space than I know what to do with. And she's Absolutely Right. What should I start filling up my storage with I already have thousands of games saved thinking about doing movies soon what else.

600
 
 
The original post: /r/datahoarder by /u/JohnTravolski on 2024-12-22 17:46:08.

I think the max capacity for M.2 NVMe drives has been stuck at 8TB for almost five years now. Is it because there physically isn't enough room on a 2280 M.2 gumstick for that many chips or is it because the demand for these would be too low?

view more: ‹ prev next ›