It's A Digital Disease!

11 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
76
 
 
The original post: /r/datahoarder by /u/JEIQmusic on 2024-12-28 23:18:29.

I've heard for several years now that SMR drives have hit the market but for some reason I've never seen a purchase link to any of them. Does anyone know what models or pages I should be looking at in order to buy one? And does anyone know if there are any storage capacities of 8TB and above when it comes to SMR drives? Thanks!

77
 
 
The original post: /r/datahoarder by /u/Regg42 on 2024-12-28 22:56:18.

Two Corsair MP 700PRO at raid 0 where each one has only x4 lanes, each disk has a cap of 16GB/s? "theoretically" the max i/o this array could get is 32GB/s?

I have the intention to perform raid 0 with 2x700PRO on this build:

9950X
X870E
192GB ram
2X Arc 16GB

I have no budget for a threadripper or HEDT, an old xeon server is not an option i need faster speeds.

My use case is virtualization of virtual machines, no games, i'll be running like 100+VM's, i'm using WIN11 not Linux, my software depend on winapi.

I have another build running with this same use case, 14700k, 64GB ram 16GB vram, its using 100% ram, 100% vram, ~50% GPU, ~80% CPU, ~60 vms.

In the X870E the second GPU will be running at x4, how bad will be the bottleneck? the applications i'm running are more memory-bound than compute-bound.

As mostly i/o performed by these vms are sequential, would raid 0 be worth on this specific case?

78
 
 
The original post: /r/datahoarder by /u/throwawaysportsvids on 2024-12-28 22:36:27.

Throwaway account due to the dubious legality of all this. I'm a long time lurker here though.

I was subscribed to a YouTube channel that restored and uploaded archival footage for a particular sport. Within the past week, that channel was taken down by that sport's leading organization (trying to keep this vague, sorry). A large number of these restorations were created using the uploader's own personal archives in the first place, and very many of the videos likely do not exist elsewhere on the internet.

There are 760 videos in total, all of which were downloaded in the best possible quality, with embedded metadata, subs, and thumbnails. My collection isn't 100% complete however, as I did not have any automated backup system in place.

As far as I can tell, this creator hasn't popped up anywhere else on YouTube yet, and I have no idea how to get in contact with them in order to coordinate uploading this archive elsewhere with them. Regardless, due to the historical significance of a lot of this footage, I'd really like to upload this archive somewhere where other people can easily access it. I'm not really sure what's the best way to go about doing this however.

I've thought about reuploading them to YouTube or to the Internet Archive, but both of those would likely be DMCA'd at some point in the future, leaving us back at square one. Additionally, my internet speeds aren't particularly fast, and doing this would likely take an incredibly significant amount of time to complete. These two factors together make me hesitant to take this approach.

Is there a better alternative to hosting this much content while avoiding DMCA's/getting myself personally into legal trouble (if at all possible)? Thanks!

79
 
 
The original post: /r/datahoarder by /u/Hell_Derpikky on 2024-12-28 22:06:39.
80
 
 
The original post: /r/datahoarder by /u/howyes on 2024-12-28 21:20:18.

Assuming its legitimately new old stock (it appears to be factory sealed still), is using old hard drive safe? I've got a decent deal on enterprise drives and I'll obviously be making a backup.

I'm probably answering my own question but I've had 15+ year old drives work with zero issues and never had a drive fail on me before but there's always a first time for everything. I'll be using it as cold storage so by the time it may fail, whatever warranty I have would probably be useless anyway.

81
 
 
The original post: /r/datahoarder by /u/Deep-Egg-6167 on 2024-12-28 21:03:19.

This happened after I reformatted my PC. I updated the firmware so it could be it doesn't like the firmware. I have my power settings set to never go to sleep - checked the PCIe settings. I'm running Win 11 latest CU and patches. Latest drivers direct from Microsemi.

My 3154 will work fine for about 2 days then suddenly go offline - Physical drive removed: controller 1 ( Unknown Unknown #Unknown Physical Slot: 2 ), channel: 0, deviceID: 13, WWN: , vendor: Not Available, model: Not Available, S/N: Not Available, firmware level: Not Available.

I reboot and the array is back on line.

Maxview shows it as missing. Says Lockup Error.

The temperature of the card is fine.

I do not see any options in Maxview that are available to force it online- but even if there was that wouldn't be a fix for my issue.

82
1
WD SN7100 (zerobytes.monster)
submitted 1 day ago by [email protected] to c/[email protected]
 
 
The original post: /r/datahoarder by /u/lensandscope on 2024-12-28 20:31:56.

I’ve did a bunch of surfing but haven’t found many reviews. Can anyone comment on their usage of the western digital sn7100 nvme ?

https://shop.sandisk.com/products/ssd/internal-ssd/wd-black-sn7100-nvme-internal-ssd?sku=WDS500G4X0E-00CJA0

83
 
 
The original post: /r/datahoarder by /u/thegiantgummybear on 2024-12-28 17:40:28.
84
 
 
The original post: /r/datahoarder by /u/SR-02-D_CJ_CD on 2024-12-28 14:58:44.

It has finally hit the stage (probably well past it) that I need to organize and properly store my data, and i will never turn down advice and recommendations from others who have more knowledge than I do. So I come hat in hand asking what your plan of action is would be if you were in my situation. So here is the run down.

SHORT TERM GOALS:

Have centralized, secure, searchable, & organized place for my pictures, video, manuals, text docs, and several other file types mostly reference material, but nothing excessively large.

Backup tons of old email but also needs to be sorted and deleted.

The ability to expand as needed, I plan on starting to save back ups of info, mostly text/pdf for offline use. and I currently do not have tons of confidence in the stability of information on the internet and there is tons of info I would not want to be lost to me or others

Have data auto upload to same location off al sources if possible

Have safe backups of all

LONG TERM GOALS:

Build my own server that I could possibly connect to from any PC

Back up all my physical media of DVD,BR, 4k movies, old CDs and 1000s of film photography pictures with negatives and/or slides.

Possible Plex server but I have so little knowledge of this I am not sure.

Download websites that I am afraid will not be there in the future. nothing huge like youtube or anything close to that.

KNOWLEDGE:

Basic computer knowledge but as far as Network and server knowledge I know just enough to know I don't know a damn thing

DATA LOCATIONS:

I have data scattered across:

Home desktop

Work desktop

Laptop personal/work

Workshop/studio laptop (not connected to internet at all times)

iPad

iPhone

Several old HDD (3 or 4)

Google drive

iCloud

I know for certain there is duplicate of a lot of things that could have been renamed or revisions at some point so that’s something to deal with as well.

It is also worth noting I am guessing I have less than 5 terabytes but 1000s of different files

CURRENT PLAN OF ATTACK:

Purchase a external hard drive and copy all needed files from all sources (partially in hopes that it weeds out some duplicate files)

Sort all files. With this i truly don't know where to start. My current guess is just going file by file and sort by broadest subject and file type and just keep going down by steps but I feel like this will take a very long time and have a high possibility of ending up with duplicate files in different locations.

Once all files sorted copy it to two separate hard drives. One installed in my desktop, one as just a detached backup, another copy zipped and saved in some cloud storage.

RESOURCES:

Other than hardware listed above not a lot.

I do have a couple hundred dollars in best buy points from CC rewards

I couple hundred dollars in cash to be able to spend on this project immediately. but definitely willing to spend a pretty reasonable amount more in the future.

Willingness to learn and figure things out.

Several old hard drives that work (not to say I trust them) and external hard drive reader.

IN CONCLUSION:

So I think that is all the pertinent information, but feel free to ask questions and I will promptly answer.

So how would you go about tackling this project?

Any software or hardware that could make this easier or better?

Any common pitfalls of people in similar situations that I should keep an eye out for?

Thanks in advance.

85
 
 
The original post: /r/datahoarder by /u/Robin-_-man on 2024-12-28 15:56:53.
86
 
 
The original post: /r/datahoarder by /u/TheRealistDude on 2024-12-28 13:06:43.

Hi, thinking to get an idrive subscription.

I prefer easy drag and drop cloud storage like mega but it's a bit pricey.

There is a problem. I don't want to install their software to upload and download files.

I'm not comfortable. So, I chatted with idrive customer support.

They said if I don't install their software and use the web interface to download, I won't be able to download "folders" that will have files. I would need to download each file one by one.

I said ok.

But, when I asked about their uptime and downtime, they said if I have good internet connection, I will get good experience lol.

How is your experience with idrive?

I just want to upload and download files from the cloud storage smoothly.

87
 
 
The original post: /r/datahoarder by /u/Onkami on 2024-12-28 12:55:22.

I am out on the market for a pair of 12-20Tb server/datacenter grade HDDs to support my media workflow (to be placed in a RAID1 array). In addition to advertised capabilities I'd like to have some facts that these drives won't fail statistically too soon.

Earlier, I chose some HGST drives by routinely comparing Backblaze failure stats with what price comparators gave me (I am in EU). Is there any way to do it faster and more straightforward?

88
 
 
The original post: /r/datahoarder by /u/General-Pen-4437 on 2024-12-28 12:55:13.

Need it for gaming since most games now weigh 150gb like Stalker 2

89
 
 
The original post: /r/datahoarder by /u/Fabulous-Ball4198 on 2024-12-28 12:29:39.

Hi,

I'm improving my little "home server" regarding power efficiency. Time for system drive.

In short story my current setup is 5x 4TB 2.5" ZFS RAIDZ, each HDD is rated as 0.85A + Samsung Evo 850 rated 1A. Evo must go...

Theory:

Storage: 0.85A = 5V * 0.85A = 4.25W/each at peak time.

System: 1A = 5V * 1A = 5W at peak time. This one must go.

Personal profile: I need only 50GB for system drive, so anything more is simply unused. This unit is remotely accessed by LAN/WiFi which is faster than HDD performance but slower than SSDs so SSD performance is not important at all as long as this is reputable SSD and not HDD.

I've tried to ask in several places so far but it seems not many people pay attention to so small details. Some said to me mSATA is most power efficient, but then I've found myself possibly (theory) some SATA more power efficient than mSATA. So, I've done little more research myself to find some SSDs basing on ratings stated on labels. I won't use NVMe, however included for others. NVMe in my opinion is the future, but not in current format, it will change at least twice in the next 10years then it will be for many years with us as best performance/power efficient solution. But this is only my own opinion.

I do it not only to save electricity but for educational purposes as well, so I'll ignore comments like "not worth saving", "not worth time". +I'm sure some minority of us will find this positive and easy database for power efficient small SSD system drive, so if you have anything lower amps in drawer (not more than 1A) and you see it not listed here, comment please, I'll update list. Target list is: not more than 1A, so we can create larger list of low powered SSDs. List shows no rule really if mSATA, SATA or power hungry NVMe if taken in to consideration only power consumption and not capacity, performance or SSD generation.

This is still very inaccurate, because:

  • Slower SSD will work longer to finish task so it may take more power on the end, or idle could be higher than other power hungry SSD

  • In different personal circumstances you will access as low as twice a day in to your system so idle power is most important, or other person dozen of time so read/write low power is more important rather than idle.

  • Someone can have really fast home internal network so performance matter where higher amps SSD will do job faster, saving overall energy. Someone else could have slower network where SSD is often waiting, so slower SSD with lower amps would be then best to save energy.

Here is no direct answer, because power hungry SSD can be still more energy efficient than low amps SSD. It all depends of personal use/system. It cannot be straight answer "which" for everyone, but by having overall labelled low power SSDs those looking for power efficiency like me could have good starting point.

Final test will be by connecting multimeter and measuring amps during normal work and taking average for own personal system profile.

SATA 5V:
Samsung 128GB: 0.5A:  PM851 MZ-7TE128D
Samsung 256GB: 0.5A:  PM871 MZ-7LN256D
Samsung 256GB: 0.43A: SM841N MZ-7PD256E
Samsung 256GB: 0.22A: MZ-7PA2560/0D1
Samsung 256GB: 0.5A:  PM871B MZ-7LN256F
Samsung 512GB: 0.5A:  SM871 MZ-7KN512D
Samsung 512GB: 0.5A:  PM851 MZ-7TE512D
mSATA 3.3V:
Samsung 128GB: 0.65A: SM841 MZ-MPD128D
Samsung 128GB: 0.31A: MZ-MPA1280/0D1
Samsung 256GB: 0.65A: SM841 MZ-MPD256D
Samsung 256GB: 0.65A: SM841N MZ-MPD256E
NVMe (mixed) 3.3V:
SanDisk 32GB: 0.35A:  SDSA6MM032G
Samsung 128GB: 0.8A:  CM871 MZ-NLF1280
LiteON 512GB: 0.95A:  CV3-8D51211

storage
SATA HDD 2.5":
Seagate 4TB: 0.85A: ST4000LM024
USB HDD 2.5":
WD Blue 4TB: 0.39A: WD40NMZW-11GX6S1

Interface extension cards:
to follow

90
 
 
The original post: /r/datahoarder by /u/Nearby_Acanthaceae_7 on 2024-12-28 12:17:46.

I wanted to share a little project I've been working on, it's a simple, self-hosted GUI for downloading media using yt-dlp. If you're tired of command-line tools and want a clean, responsive interface to grab videos or audio from platforms like YouTube, this might be just what you're looking for.

How It Works:

  • It uses a lightweight Express.js server to handle downloads via yt-dlp.
  • The front end is built with plain HTML, CSS, and JavaScript, keeping it simple and easy to customize.

It's prob been done a thousand times, but I couldn't find one that I liked. Any errors etc, let me know and I will fix them.

You can download it here via GitHub

Give it a ⭐ if you like it.

91
 
 
The original post: /r/datahoarder by /u/burcbuluklu on 2024-12-28 12:16:07.

I'm trying to clone the repo https://web.archive.org/web/20240821165044/https://github.com/LeeeSe/MessAuto but idk how to access the files.

92
 
 
The original post: /r/datahoarder by /u/MountainAny320 on 2024-12-28 12:07:16.

As the title says, I'm looking for people who can backup such content ( tv shows, movies, comics, books, magazines, softwares, games and what not) and share back to the community when it's needed. I will provide you all the telegram sources which are dying day by day. Some of them have very good content and I've tried my best to archive whatever I could but I do have a limit and I'm looking for some help from large datahoarders.

Please dm me if you are interested and what kind of content you are willing to archive.

93
 
 
The original post: /r/datahoarder by /u/RENRENREN1 on 2024-12-28 10:09:02.

Finally putting an end to my eternal struggle with lack of storage on my desktop pc!! I'm thinking of getting the 8 TB of Seagate exos but someone also suggested the ironwolf pro what do you guys think? it'll mostly be for storing movies, random files and photos what are the pros and cons of using these drives on a regular desktop pc?

94
 
 
The original post: /r/datahoarder by /u/Anita_Spanken on 2024-12-28 09:50:30.

Original Title: Turns out my parents kept all of our old computers and hard drives! I want to move all of the old files and photos from our old hard drives to one new SSD so I can have all of our family photos in one place!


I want to just be able to plug an old drive in (I'm gonna buy a HDD dock) and then copy all of the files of one type like photos (jpeg AND png, etc) to ONE new folder on my new SSD. I don't wanna have to look through each folder and subfolder and stuff on the old computers and I want to preserve the metadata so that I can have everything in a chronological order and know what years photos were taken.

Whats the best file management app to aggregate stuff with?

95
 
 
The original post: /r/datahoarder by /u/SubtiltyCypress on 2024-12-28 06:29:20.

Hello, looking to build a NAS using the AMD R7 5700G from my PC and replace that eith a 5800x3D but seeing so many here use Intel instead of AMD makes me wonder if it is good enough. I dont think I need much transcoding since I'm only planning on using it on my PC or a TV streamer eventually. All in the same room. And it has integrated graphics so I don't need a seperate GPU but do wonder if it can handle 4K Remuxes. Thinking 10TB drives but can save up more for 15. Other services I will use on it include Roon, maybe HQPlayer, a constant VPN and probably some AI stuff down the line. If I dont need as much RAM or any cheaper parts youd siggest I would appreciate that too. Thank you!

| Part Type | Part Name | Price | |


|


|


| | OS | TrueNas Scale | Free | | CPU | Ryzen 7 5700G | Free | | Motherboard | MSI Pro B550M-VC WIFI | 110 | | Cooler | Thermalright AXP90 X47 | 23 | | RAM | Silicon Power Value Gaming DDR4 3200 64GB (4x16) | 88 (2 32GB sets at 44 each) | | M.2 SSD | Silicon Power A55 1TB x2 PCiE 3.0 | 88 (2 each at 44 each) | | HDD | Seagate Exos X10 10TB | 110x6 | | Power Supply | Thermaltake Toughpower GX2 80+ Gold 600W | 70 | | Case | Silverstone Technology CS351 5 Bay NAS | 189 | | Price | | 1228 |

96
 
 
The original post: /r/datahoarder by /u/leo72793 on 2024-12-28 05:49:56.

Hello, First time poster here.

I have a WD Blue WDBH2D0040HNC 4TB that randomly died. Used it fine 3 days ago and now just unreadable.

Im using it in my rig (gaming PC) as an emulation drive for ISO files, game emulators and different versions of games that have mod packs.

What is the 2024 replacement recommendation here? Ive had bad luck with Seagate Barracuda drives in the past failing a few days out of warranty (good ole 3TB issues back then). I wish i had a backup set for my T630 so i could just replace and recover the entire drive! big mistake on my part.

97
 
 
The original post: /r/datahoarder by /u/ZooterTheWooter on 2024-12-28 05:47:37.

Trying to download the yugioh card database. Was curious for methods to save it offline? I've never downloaded a webpage offline before so sort of new to this.

98
1
4u chasis (zerobytes.monster)
submitted 2 days ago by [email protected] to c/[email protected]
 
 
The original post: /r/datahoarder by /u/ftp_prodigy on 2024-12-28 03:35:44.

so this reminds me of the norco 34 bay setups. did i miss something? is anyone using anything like this? im currently on a rosewill l4500u and i been kicking around the idea of getting a larger case (more drive bays)

99
 
 
The original post: /r/datahoarder by /u/rabblebabbledabble on 2024-12-27 22:58:43.

Hey,

for the last few hours I've been trying to archive someone's twitter feed. I just need the text, I can live without the images. This has been been brought up on this subreddit a bunch of times and I tried everything suggested here and more. I'm at my wits' end. So, did anyone actually successfully do this in the last few months? Is it even possible without using the official Twitter API?

Through this evening I installed and used all kinds of browser add-ons, Python, twint, git, visual c++ build tools, docker, snscrape, an older version of Python, ntscraper, Nitter...

One of the add-ons managed 100 tweets (before asking for money) and Nitter got me ~~18~~ 56. Delays and retries just produced the same 18 tweets over and over again. Everything else failed completely.

So, again, is there anybody here who has accomplished this feat in 2024?

Thank you!

Edit: Managed to get from 18 to 56 with Nitter today by changing the code a bit.

100
 
 
The original post: /r/datahoarder by /u/andreas0069 on 2024-12-27 20:50:56.
view more: ‹ prev next ›