It's A Digital Disease!

11 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
376
 
 
The original post: /r/datahoarder by /u/Regg42 on 2024-12-28 22:56:18.

Two Corsair MP 700PRO at raid 0 where each one has only x4 lanes, each disk has a cap of 16GB/s? "theoretically" the max i/o this array could get is 32GB/s?

I have the intention to perform raid 0 with 2x700PRO on this build:

9950X
X870E
192GB ram
2X Arc 16GB

I have no budget for a threadripper or HEDT, an old xeon server is not an option i need faster speeds.

My use case is virtualization of virtual machines, no games, i'll be running like 100+VM's, i'm using WIN11 not Linux, my software depend on winapi.

I have another build running with this same use case, 14700k, 64GB ram 16GB vram, its using 100% ram, 100% vram, ~50% GPU, ~80% CPU, ~60 vms.

In the X870E the second GPU will be running at x4, how bad will be the bottleneck? the applications i'm running are more memory-bound than compute-bound.

As mostly i/o performed by these vms are sequential, would raid 0 be worth on this specific case?

377
 
 
The original post: /r/datahoarder by /u/throwawaysportsvids on 2024-12-28 22:36:27.

Throwaway account due to the dubious legality of all this. I'm a long time lurker here though.

I was subscribed to a YouTube channel that restored and uploaded archival footage for a particular sport. Within the past week, that channel was taken down by that sport's leading organization (trying to keep this vague, sorry). A large number of these restorations were created using the uploader's own personal archives in the first place, and very many of the videos likely do not exist elsewhere on the internet.

There are 760 videos in total, all of which were downloaded in the best possible quality, with embedded metadata, subs, and thumbnails. My collection isn't 100% complete however, as I did not have any automated backup system in place.

As far as I can tell, this creator hasn't popped up anywhere else on YouTube yet, and I have no idea how to get in contact with them in order to coordinate uploading this archive elsewhere with them. Regardless, due to the historical significance of a lot of this footage, I'd really like to upload this archive somewhere where other people can easily access it. I'm not really sure what's the best way to go about doing this however.

I've thought about reuploading them to YouTube or to the Internet Archive, but both of those would likely be DMCA'd at some point in the future, leaving us back at square one. Additionally, my internet speeds aren't particularly fast, and doing this would likely take an incredibly significant amount of time to complete. These two factors together make me hesitant to take this approach.

Is there a better alternative to hosting this much content while avoiding DMCA's/getting myself personally into legal trouble (if at all possible)? Thanks!

378
 
 
The original post: /r/datahoarder by /u/Hell_Derpikky on 2024-12-28 22:06:39.
379
 
 
The original post: /r/datahoarder by /u/howyes on 2024-12-28 21:20:18.

Assuming its legitimately new old stock (it appears to be factory sealed still), is using old hard drive safe? I've got a decent deal on enterprise drives and I'll obviously be making a backup.

I'm probably answering my own question but I've had 15+ year old drives work with zero issues and never had a drive fail on me before but there's always a first time for everything. I'll be using it as cold storage so by the time it may fail, whatever warranty I have would probably be useless anyway.

380
 
 
The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2024-12-28 21:03:19.

This happened after I reformatted my PC. I updated the firmware so it could be it doesn't like the firmware. I have my power settings set to never go to sleep - checked the PCIe settings. I'm running Win 11 latest CU and patches. Latest drivers direct from Microsemi.

My 3154 will work fine for about 2 days then suddenly go offline - Physical drive removed: controller 1 ( Unknown Unknown #Unknown Physical Slot: 2 ), channel: 0, deviceID: 13, WWN: , vendor: Not Available, model: Not Available, S/N: Not Available, firmware level: Not Available.

I reboot and the array is back on line.

Maxview shows it as missing. Says Lockup Error.

The temperature of the card is fine.

I do not see any options in Maxview that are available to force it online- but even if there was that wouldn't be a fix for my issue.

381
1
WD SN7100 (zerobytes.monster)
submitted 1 week ago by [email protected] to c/[email protected]
 
 
The original post: /r/datahoarder by /u/lensandscope on 2024-12-28 20:31:56.

I’ve did a bunch of surfing but haven’t found many reviews. Can anyone comment on their usage of the western digital sn7100 nvme ?

https://shop.sandisk.com/products/ssd/internal-ssd/wd-black-sn7100-nvme-internal-ssd?sku=WDS500G4X0E-00CJA0

382
 
 
The original post: /r/datahoarder by /u/thegiantgummybear on 2024-12-28 17:40:28.
383
 
 
The original post: /r/datahoarder by /u/SR-02-D_CJ_CD on 2024-12-28 14:58:44.

It has finally hit the stage (probably well past it) that I need to organize and properly store my data, and i will never turn down advice and recommendations from others who have more knowledge than I do. So I come hat in hand asking what your plan of action is would be if you were in my situation. So here is the run down.

SHORT TERM GOALS:

Have centralized, secure, searchable, & organized place for my pictures, video, manuals, text docs, and several other file types mostly reference material, but nothing excessively large.

Backup tons of old email but also needs to be sorted and deleted.

The ability to expand as needed, I plan on starting to save back ups of info, mostly text/pdf for offline use. and I currently do not have tons of confidence in the stability of information on the internet and there is tons of info I would not want to be lost to me or others

Have data auto upload to same location off al sources if possible

Have safe backups of all

LONG TERM GOALS:

Build my own server that I could possibly connect to from any PC

Back up all my physical media of DVD,BR, 4k movies, old CDs and 1000s of film photography pictures with negatives and/or slides.

Possible Plex server but I have so little knowledge of this I am not sure.

Download websites that I am afraid will not be there in the future. nothing huge like youtube or anything close to that.

KNOWLEDGE:

Basic computer knowledge but as far as Network and server knowledge I know just enough to know I don't know a damn thing

DATA LOCATIONS:

I have data scattered across:

Home desktop

Work desktop

Laptop personal/work

Workshop/studio laptop (not connected to internet at all times)

iPad

iPhone

Several old HDD (3 or 4)

Google drive

iCloud

I know for certain there is duplicate of a lot of things that could have been renamed or revisions at some point so that’s something to deal with as well.

It is also worth noting I am guessing I have less than 5 terabytes but 1000s of different files

CURRENT PLAN OF ATTACK:

Purchase a external hard drive and copy all needed files from all sources (partially in hopes that it weeds out some duplicate files)

Sort all files. With this i truly don't know where to start. My current guess is just going file by file and sort by broadest subject and file type and just keep going down by steps but I feel like this will take a very long time and have a high possibility of ending up with duplicate files in different locations.

Once all files sorted copy it to two separate hard drives. One installed in my desktop, one as just a detached backup, another copy zipped and saved in some cloud storage.

RESOURCES:

Other than hardware listed above not a lot.

I do have a couple hundred dollars in best buy points from CC rewards

I couple hundred dollars in cash to be able to spend on this project immediately. but definitely willing to spend a pretty reasonable amount more in the future.

Willingness to learn and figure things out.

Several old hard drives that work (not to say I trust them) and external hard drive reader.

IN CONCLUSION:

So I think that is all the pertinent information, but feel free to ask questions and I will promptly answer.

So how would you go about tackling this project?

Any software or hardware that could make this easier or better?

Any common pitfalls of people in similar situations that I should keep an eye out for?

Thanks in advance.

384
 
 
The original post: /r/datahoarder by /u/Robin-_-man on 2024-12-28 15:56:53.
385
 
 
The original post: /r/datahoarder by /u/TheRealistDude on 2024-12-28 13:06:43.

Hi, thinking to get an idrive subscription.

I prefer easy drag and drop cloud storage like mega but it's a bit pricey.

There is a problem. I don't want to install their software to upload and download files.

I'm not comfortable. So, I chatted with idrive customer support.

They said if I don't install their software and use the web interface to download, I won't be able to download "folders" that will have files. I would need to download each file one by one.

I said ok.

But, when I asked about their uptime and downtime, they said if I have good internet connection, I will get good experience lol.

How is your experience with idrive?

I just want to upload and download files from the cloud storage smoothly.

386
 
 
The original post: /r/datahoarder by /u/Onkami on 2024-12-28 12:55:22.

I am out on the market for a pair of 12-20Tb server/datacenter grade HDDs to support my media workflow (to be placed in a RAID1 array). In addition to advertised capabilities I'd like to have some facts that these drives won't fail statistically too soon.

Earlier, I chose some HGST drives by routinely comparing Backblaze failure stats with what price comparators gave me (I am in EU). Is there any way to do it faster and more straightforward?

387
 
 
The original post: /r/datahoarder by /u/General-Pen-4437 on 2024-12-28 12:55:13.

Need it for gaming since most games now weigh 150gb like Stalker 2

388
 
 
The original post: /r/datahoarder by /u/Fabulous-Ball4198 on 2024-12-28 12:29:39.

Hi,

I'm improving my little "home server" regarding power efficiency. Time for system drive.

In short story my current setup is 5x 4TB 2.5" ZFS RAIDZ, each HDD is rated as 0.85A + Samsung Evo 850 rated 1A. Evo must go...

Theory:

Storage: 0.85A = 5V * 0.85A = 4.25W/each at peak time.

System: 1A = 5V * 1A = 5W at peak time. This one must go.

Personal profile: I need only 50GB for system drive, so anything more is simply unused. This unit is remotely accessed by LAN/WiFi which is faster than HDD performance but slower than SSDs so SSD performance is not important at all as long as this is reputable SSD and not HDD.

I've tried to ask in several places so far but it seems not many people pay attention to so small details. Some said to me mSATA is most power efficient, but then I've found myself possibly (theory) some SATA more power efficient than mSATA. So, I've done little more research myself to find some SSDs basing on ratings stated on labels. I won't use NVMe, however included for others. NVMe in my opinion is the future, but not in current format, it will change at least twice in the next 10years then it will be for many years with us as best performance/power efficient solution. But this is only my own opinion.

I do it not only to save electricity but for educational purposes as well, so I'll ignore comments like "not worth saving", "not worth time". +I'm sure some minority of us will find this positive and easy database for power efficient small SSD system drive, so if you have anything lower amps in drawer (not more than 1A) and you see it not listed here, comment please, I'll update list. Target list is: not more than 1A, so we can create larger list of low powered SSDs. List shows no rule really if mSATA, SATA or power hungry NVMe if taken in to consideration only power consumption and not capacity, performance or SSD generation.

This is still very inaccurate, because:

  • Slower SSD will work longer to finish task so it may take more power on the end, or idle could be higher than other power hungry SSD

  • In different personal circumstances you will access as low as twice a day in to your system so idle power is most important, or other person dozen of time so read/write low power is more important rather than idle.

  • Someone can have really fast home internal network so performance matter where higher amps SSD will do job faster, saving overall energy. Someone else could have slower network where SSD is often waiting, so slower SSD with lower amps would be then best to save energy.

Here is no direct answer, because power hungry SSD can be still more energy efficient than low amps SSD. It all depends of personal use/system. It cannot be straight answer "which" for everyone, but by having overall labelled low power SSDs those looking for power efficiency like me could have good starting point.

Final test will be by connecting multimeter and measuring amps during normal work and taking average for own personal system profile.

SATA 5V:
Samsung 128GB: 0.5A:  PM851 MZ-7TE128D
Samsung 256GB: 0.5A:  PM871 MZ-7LN256D
Samsung 256GB: 0.43A: SM841N MZ-7PD256E
Samsung 256GB: 0.22A: MZ-7PA2560/0D1
Samsung 256GB: 0.5A:  PM871B MZ-7LN256F
Samsung 512GB: 0.5A:  SM871 MZ-7KN512D
Samsung 512GB: 0.5A:  PM851 MZ-7TE512D
mSATA 3.3V:
Samsung 128GB: 0.65A: SM841 MZ-MPD128D
Samsung 128GB: 0.31A: MZ-MPA1280/0D1
Samsung 256GB: 0.65A: SM841 MZ-MPD256D
Samsung 256GB: 0.65A: SM841N MZ-MPD256E
NVMe (mixed) 3.3V:
SanDisk 32GB: 0.35A:  SDSA6MM032G
Samsung 128GB: 0.8A:  CM871 MZ-NLF1280
LiteON 512GB: 0.95A:  CV3-8D51211

storage
SATA HDD 2.5":
Seagate 4TB: 0.85A: ST4000LM024
USB HDD 2.5":
WD Blue 4TB: 0.39A: WD40NMZW-11GX6S1

Interface extension cards:
to follow

389
 
 
The original post: /r/datahoarder by /u/Nearby_Acanthaceae_7 on 2024-12-28 12:17:46.

I wanted to share a little project I've been working on, it's a simple, self-hosted GUI for downloading media using yt-dlp. If you're tired of command-line tools and want a clean, responsive interface to grab videos or audio from platforms like YouTube, this might be just what you're looking for.

How It Works:

  • It uses a lightweight Express.js server to handle downloads via yt-dlp.
  • The front end is built with plain HTML, CSS, and JavaScript, keeping it simple and easy to customize.

It's prob been done a thousand times, but I couldn't find one that I liked. Any errors etc, let me know and I will fix them.

You can download it here via GitHub

Give it a ⭐ if you like it.

390
 
 
The original post: /r/datahoarder by /u/burcbuluklu on 2024-12-28 12:16:07.

I'm trying to clone the repo https://web.archive.org/web/20240821165044/https://github.com/LeeeSe/MessAuto but idk how to access the files.

391
 
 
The original post: /r/datahoarder by /u/MountainAny320 on 2024-12-28 12:07:16.

As the title says, I'm looking for people who can backup such content ( tv shows, movies, comics, books, magazines, softwares, games and what not) and share back to the community when it's needed. I will provide you all the telegram sources which are dying day by day. Some of them have very good content and I've tried my best to archive whatever I could but I do have a limit and I'm looking for some help from large datahoarders.

Please dm me if you are interested and what kind of content you are willing to archive.

392
 
 
The original post: /r/datahoarder by /u/RENRENREN1 on 2024-12-28 10:09:02.

Finally putting an end to my eternal struggle with lack of storage on my desktop pc!! I'm thinking of getting the 8 TB of Seagate exos but someone also suggested the ironwolf pro what do you guys think? it'll mostly be for storing movies, random files and photos what are the pros and cons of using these drives on a regular desktop pc?

393
 
 
The original post: /r/datahoarder by /u/Anita_Spanken on 2024-12-28 09:50:30.

Original Title: Turns out my parents kept all of our old computers and hard drives! I want to move all of the old files and photos from our old hard drives to one new SSD so I can have all of our family photos in one place!


I want to just be able to plug an old drive in (I'm gonna buy a HDD dock) and then copy all of the files of one type like photos (jpeg AND png, etc) to ONE new folder on my new SSD. I don't wanna have to look through each folder and subfolder and stuff on the old computers and I want to preserve the metadata so that I can have everything in a chronological order and know what years photos were taken.

Whats the best file management app to aggregate stuff with?

394
 
 
The original post: /r/datahoarder by /u/SubtiltyCypress on 2024-12-28 06:29:20.

Hello, looking to build a NAS using the AMD R7 5700G from my PC and replace that eith a 5800x3D but seeing so many here use Intel instead of AMD makes me wonder if it is good enough. I dont think I need much transcoding since I'm only planning on using it on my PC or a TV streamer eventually. All in the same room. And it has integrated graphics so I don't need a seperate GPU but do wonder if it can handle 4K Remuxes. Thinking 10TB drives but can save up more for 15. Other services I will use on it include Roon, maybe HQPlayer, a constant VPN and probably some AI stuff down the line. If I dont need as much RAM or any cheaper parts youd siggest I would appreciate that too. Thank you!

| Part Type | Part Name | Price | |


|


|


| | OS | TrueNas Scale | Free | | CPU | Ryzen 7 5700G | Free | | Motherboard | MSI Pro B550M-VC WIFI | 110 | | Cooler | Thermalright AXP90 X47 | 23 | | RAM | Silicon Power Value Gaming DDR4 3200 64GB (4x16) | 88 (2 32GB sets at 44 each) | | M.2 SSD | Silicon Power A55 1TB x2 PCiE 3.0 | 88 (2 each at 44 each) | | HDD | Seagate Exos X10 10TB | 110x6 | | Power Supply | Thermaltake Toughpower GX2 80+ Gold 600W | 70 | | Case | Silverstone Technology CS351 5 Bay NAS | 189 | | Price | | 1228 |

395
 
 
The original post: /r/datahoarder by /u/leo72793 on 2024-12-28 05:49:56.

Hello, First time poster here.

I have a WD Blue WDBH2D0040HNC 4TB that randomly died. Used it fine 3 days ago and now just unreadable.

Im using it in my rig (gaming PC) as an emulation drive for ISO files, game emulators and different versions of games that have mod packs.

What is the 2024 replacement recommendation here? Ive had bad luck with Seagate Barracuda drives in the past failing a few days out of warranty (good ole 3TB issues back then). I wish i had a backup set for my T630 so i could just replace and recover the entire drive! big mistake on my part.

396
 
 
The original post: /r/datahoarder by /u/ZooterTheWooter on 2024-12-28 05:47:37.

Trying to download the yugioh card database. Was curious for methods to save it offline? I've never downloaded a webpage offline before so sort of new to this.

397
1
4u chasis (zerobytes.monster)
submitted 1 week ago by [email protected] to c/[email protected]
 
 
The original post: /r/datahoarder by /u/ftp_prodigy on 2024-12-28 03:35:44.

so this reminds me of the norco 34 bay setups. did i miss something? is anyone using anything like this? im currently on a rosewill l4500u and i been kicking around the idea of getting a larger case (more drive bays)

398
 
 
The original post: /r/datahoarder by /u/rabblebabbledabble on 2024-12-27 22:58:43.

Hey,

for the last few hours I've been trying to archive someone's twitter feed. I just need the text, I can live without the images. This has been been brought up on this subreddit a bunch of times and I tried everything suggested here and more. I'm at my wits' end. So, did anyone actually successfully do this in the last few months? Is it even possible without using the official Twitter API?

Through this evening I installed and used all kinds of browser add-ons, Python, twint, git, visual c++ build tools, docker, snscrape, an older version of Python, ntscraper, Nitter...

One of the add-ons managed 100 tweets (before asking for money) and Nitter got me ~~18~~ 56. Delays and retries just produced the same 18 tweets over and over again. Everything else failed completely.

So, again, is there anybody here who has accomplished this feat in 2024?

Thank you!

Edit: Managed to get from 18 to 56 with Nitter today by changing the code a bit.

399
 
 
The original post: /r/datahoarder by /u/andreas0069 on 2024-12-27 20:50:56.
400
 
 
The original post: /r/datahoarder by /u/LaundryMan2008 on 2024-12-27 20:34:16.

I am the crazy person that bought the 4 broken LTO tape drives if anyone else bid on them, I was able to successfully fix 2 of the 4 for now (don’t have a read write compatible tape for the LTO-5 tape drives but had a LTO-3 tape which worked with the LTO-4 drives), one had a stuck tape which I removed, unfortunately (because I will now need to buy a tape to test the LTO-5 drives instead of the one that came with the lot so that tape is going on my wall) the tape was chewed up and ripped off but I was able to thread the leader back into the mechanism so it now loads tapes and works like it should (didn’t get a FC card and cable just yet because of this hurdle), the other one that I fixed with a mystery error was a mech error 5 which was 2 stripped gears in the loading mechanism which I used my broken tape drive as a donor for but it had bad heads too so I also gave the error 5 drive some new heads from the donor drive.

What I bought: https://www.ebay.co.uk/itm/267094647139

Edit: bad link, not sure why it’s sending me to a tape library but if you search broken LTO tape drives and turn on sold listings then you should find a listing of 4 LTO library drives with one having a tape stuck in it for £42 which is the one I bought

The drive with the stuck tape was a HP FH LTO-4 FC drive so I couldn’t test it any further and see if it showed up because I didn’t have a FC card  but the other IBM HH LTO-4 SAS tape drive worked but had the library setting turned on so I couldn’t use it but since I had a donor drive, I just took the motherboard and swapped it which made it show up on ITDT and passed all of its tests with flying colors.

Before I go ahead and order any tapes or cards for the real moneymakers which are the LTO-5s (intended on keeping the HP LTO-4 drive and selling the rest because I want to have a tape drive of every even numbered generation so that I could fully read and write all of the LTO tapes in the series with the least amount of drives and the money from selling the rest of the tape drives will go towards an IBM 3592 TS1130 drive to mess around with and set up on my system), I will need to convert the tape drives from library mode into standalone internal drives so that they would show up as normal because I don’t have spare motherboards to swap in so I would like to learn how to convert a tape drive to make it show up as normal for now, for future use and so that I could make a step by step guide that is easily understandable by a mere mortal then just the Linux wizards.

I read the GitHub post on doing it but had a hard time understanding on how to do it partially because I mainly worked on electronics and hardware and also because of neurodivergence making it hard to understand stuff if not explained in a simple way, I believe (correct me if I’m wrong) I understand the electrical part which I’ll need to get a USB to UART converter (I understand that I can’t simply use the USB data connections so that’s what the UART converter is for after reading up on serial standards) and connect up the wires to the right connections on the tape drive but then actually sending the command to the drive is confusing to me because the GitHub OP used Linux to achieve this and I tried setting up WSL for it and creating the bash script before getting any hardware but it gave a error about not finding the USB device which I can understand but I wanted to know that a solution will work properly so that I don’t buy unnecessary stuff and also I would like a simpler solution than sorcererous Linux incantations cast on the tape drive because I read a few comments on the post where they sent a 0 to the drive and received the tape drive model and firmware back which means that they used some sort of terminal software and typed in the 0 and the hex command themselves instead of a bash script and got the response in a human readable way which I would prefer for myself and future people that would find the simpler step by step guide that doesn’t involve Linux for those people that can’t use it or aren’t as tech savvy.

GitHub post: https://github.com/AC7RNsphnHVbyT4/ibm-tape-drive-automatic-standalone

The final step after getting the other tape drive online and working would be to make a .STL and 3D print some faceplates which you guys would appreciate over the overpriced bezels on eBay and to put on my tape drives, I will also make a documenting post on my repair journey and my pitfalls.

A video of one of my tape drives after repair: https://imgur.com/gallery/video-of-hp-lto-4-tape-drive-working-after-threading-leader-tape-back-through-mechanism-HxWT6G7

Thank you for your help and I hope you got warehouse sized hard drives for Christmas to hoard on :)

Edit: don’t downvote my question of help for god’s sake, I hate that going to the right sub and asking there only gets me downvoted with no help at all D:

The ones on the left are the LTO-5 drives I haven’t made a start on, the middle one is the donor tape drive and the ones on the right are the ones I fixed

Some spoilers of my repair work that I’ll make a journey post on (I already make these types of posts on vintage appliances forums where I document what I did restoring something)

Tape in a mess of ribbons and you can see the leader clip hanging out the front

Tape drive with new heads in it

view more: ‹ prev next ›