It's A Digital Disease!

The original post: /r/datahoarder by /u/gunnesaxophone on 2024-12-06 19:48:39.

Hello! Hope this is appropriate to post here (if there are other communities you guys know of that might have tips on this please let me know!).

I came into possession of a HUGE collection of antique & vintage (1910s-90s) sewing patterns from a deaccessioned museum collection including sewing guides, magazines, and other ephemera. I don't sew so I've been selling the patterns on eBay, but several of the guides (particularly the WWII era ones) seem pretty special and I feel like I should digitize them somehow.

Does anyone here know of a place I could digitize them for free public access? I'm no archivist but I love history and feel like I should make some kind of an effort to get these out there for people who might be interested!

The original post: /r/datahoarder by /u/FamousLastWords_keys on 2024-12-06 19:41:27.

TL;DR: The file management app Eagle has a feature to download all the images from any page no matter how long it is. Zero technical knowledge required.

Context:

I'm an artist with massive amounts of saved art for inspiration and admiration in twitter and instagram bookmarks, pinterest, etc. It's all unwieldy and impossible to find what I need when I need it. So I was looking at https://eagle.cool/ to manage my library. Turns out they have fantastic downloading tools built in.

Problem:

Twitter bookmarks have proved particularly troublesome because there's no unique url for a user's saved bookmarks. I lack the coding knowledge or time to pull images with a script or other solution. And muskrat crippling the API a few years back made other tools I'd seen unusable.

Solve:

It turns out that Eagle's method for importing from Pinterest boards works for any page with a lot of images, including twitter bookmarks. It scrolled and pulled automatically from the page and collected over 3,000 images with source links intact. If you use other Eagle features you can get additional information, like the tweet text, but being able to press a single button and get all my saved images with no extra work was a worthwhile tradeoff.

https://en.eagle.cool/article/517-import-from-pinterest

The original post: /r/datahoarder by /u/uluqat on 2024-12-06 19:08:20.

The original post: /r/datahoarder by /u/AmbitiousYak4557 on 2024-12-06 18:21:26.

My apologies if this is the wrong place or way to ask.

In the wake of recent events health insurance (and other industries) companies have started pulling their C level executive information from their websites.

If someone were to host a website containing all the wayback/archive.org/etc links (these would only be links to archives, it would only contain the original information made public by the corporation,) could this be considered doxxing or otherwise construed as illegal?

For obvious reasons, the website would be read-only for any and all external parties; This would just be my archive for 'personal' use, hosted publically with only URLs and company names.

The original post: /r/datahoarder by /u/thegameksk on 2024-12-06 17:49:20.

I have been using OMV with mergerfs and snapraid. I mainly use my NAS as a media hub (plex, books, comics) and automated downloader. My issue with my setup is it never lasts long. 3 times over the past 4 years after a certain amount of time my downloader doesnt see all my drives pooled as one and it will only see each individual drive. On the OMV forums they told me the issue is mergerfs and no matter what I do after a certain amount of time my downloader will lose the ability to see my pooled drives. When this happens I have to nuke and start from scratch. Any advice?

The original post: /r/datahoarder by /u/kaitlyn2004 on 2024-12-06 17:20:56.

Current setup:

• PC
• Internal 8TB drive
• 2TB USB SSD
• 4 bay NAS
• 2 bay NAS
• Amazon Drive

What I'm looking to store is 99% photos. It's primarily storage of my "done" photos (my "active" photos reside on the SSD). I am currently sitting around 5.5TB of photos/other document storage+backup. Obviously it's still growing, but MUCH more slowly now. Drive storage space now vastly outpaces my needs. "done" photos do still get accessed, but much less so.

Changes:

• My 4 bay NAS (DS413J) is at capacity and also basically end of life. The drive trays and the OS lack reliable support for larger drive sizes... plus any time I log into the NAS, it's sooo sluggish.
• My 2 bay NAS is even older and was basically just "extra". It's EOL too though. It was originally stored offsite, but I don't have that (easily) option anymore. It's just JBOD right now anyway...
• Retiring PC, moving to MacBook Pro
• Was using Cloud Sync on the Synology NAS to back up photos to Amazon Drive. This is now discontinued.
• Got a new 4TB NVMe drive to replace my 2TB SSD... faster access to lightroom catalog+"active" photos

Assumptions:

• My need for Amazon Drive is probably close to zero now?
• I don't THINK I want/need a newer replacement Synology NAS. The entry price is high and I don't have the need for remote networked access to the photos on the go, nor do I THINK I would make use of any of the packages Synology offers? Photo Station... I use Lightroom.
• SSD is amazing for fast access, but I heard it's not a good backup medium?
• Especially since moving to a laptop, I won't have PC running 24/7 to do overnight backups or whatever

Working backwards on the "3-2-1" backup...

• I could move to Backblaze b2 for the storage. Seems relatively affordable, but I also don't love the idea of paying $60 USD/month (for 10TB) indefinitely? But like I mentioned above, I no longer have the ability to just easily keep a NAS/device offsite while still having somewhat regular access to it.
• I just bought Seagate Expansion 14TB. It could be primary backup, or just primary storage device? If backup... I think I'd still have to do something like keep it in a drawer, and hook up once a week/month and back up or something?
• Would like to be able to have faster primary photo storage, but 2.5" SSDs seem to top out at 4TB, and an 8TB NVMe is so pricey... and will run out in the forseeable future, only to be replaced by an even more expensive larger NVMe?

So...

Any recommendations for faster primary storage? That's ideally 10TB+? How do you normally handle backing up to a USB drive? Just create a reminder for yourself? Better option than backblaze assuming it's a last-resort data recovery situation?

The original post: /r/datahoarder by /u/ehead on 2024-12-06 16:54:29.

Looking to pick up my first JBOD DAS to set up with something (still deciding between unraid, snapraid + mergerfs, and drivepool).

This thing is going to be sitting right next to me most of the day, so I put a priority on quiet.

Some questions:

1. Does vertical vs. horizontal make much difference, aside from whatever fits best? That brings me to my second question...

2. Where should a DAS like this be placed? I have my ext. hard drives just sitting on the same wooden shelf structure as my laptop. It occurred to me that vibrations and stuff may effect drive lifespan. Not sure if the floor would be any better though, tbh.

If anybody has any comments on the noise level, build quality, or reliability of the 4 units posted below that would be great.

From what I have gathered the fan noise is somewhat dependent on the fan size. The SABRENT has a 120mm. I think the QNAP does as well. Not sure about the others. Think I'm leaning towards the Syba though, because the price is pretty good and it can take laptop drives as well, which I think may be useful.

Thanks!

Syba 8 Bay (either the USB 3.0 or 3.2)

https://www.amazon.com/gp/product/B07MD2LNYX

SABRENT 5 Bay

https://www.amazon.com/gp/product/B07Y4F5SCK/

TERRAMASTER D6-320

https://www.amazon.com/TERRAMASTER-D6-320-External-Drive-Enclosure/dp/B0BZHSK29B

QNAP TL-D800C 8 Bay

https://www.amazon.com/QNAP-TL-D800C-Desktop-Enclosure-Connectivity/dp/B086WCRFQ3

The original post: /r/datahoarder by /u/WirtsLegs on 2024-12-06 16:37:41.

So I have a pretty large setup at home, its all racked and all good there, however one thing I am missing is a proper off-site backup solution for critical data.

Now I got into self-hosting/homelabbing, among other reasons, as a way to cut cords from subscription services so I would rather avoid commercial backup solutions or even things like a cloud storage bucket.

I have permission from my parents to plug in a small server in exchange for their access to my media, I am thinking a minipc of some kind (likely N100), and then just a USB enclosure of some kind.

My minimum is 4 bays, and I want to avoid "NAS" solutions like Synology etc, just need a dumb enclosure that will expose the individual drives (planning ZFS) and perform well hooked to a minipc running proxmox backup server and a VPN client. No rack there so prefer the consumer targeted options that can sit on a small shelf.

thanks in advance!

The original post: /r/datahoarder by /u/Orbitalsp3 on 2024-12-06 16:04:45.

The other CC video about hard disks has been posted here already 3 times, but this one about Optical Storage Devices hasn't. So let's discuss this one a bit?

Half a billion bytes of information on a CD??? Dangg

Story time: I had a CD burner that kept ruining discs for me at the time of recording, but would succeed like 70% of the time (and discs were expensive). I was a kid and didn't know what was going on. Today I know, it was obviously the power supply which was a lower quality and not supplying proper/stable power.

https://www.youtube.com/watch?v=5TcsOgy9weg

The original post: /r/datahoarder by /u/ThatDeveloper12 on 2024-12-06 14:53:47.

Assuming that a tape library like a TS3200 has new enough firmware for a given generation of SAS drive, if I buy one without drives can I stuff any LTO drive into it that has the appropriate physical sled? So far as I can tell the licences for the TS3200 do things like path failover, encryption, or stuff like that. Do you additionally need to licence a drive that didn't come with the library to work with it?

The original post: /r/datahoarder by /u/Natrome_tex on 2024-12-06 14:25:13.

https://preview.redd.it/ixbvlqbum85e1.png?width=456&format=png&auto=webp&s=2d206ac8f639f173018f8d6f7f0e0bf0fbb31f78

The original post: /r/datahoarder by /u/marioarm on 2024-12-06 12:05:55.

https://en.wikipedia.org/wiki/Quantum_Bigfoot

I wouldn't mind in some cases have chunky drive to get chunky capacity at good value. Despite many cases not supporting anything bigger than 3.5"

Wondering if the chunky drive market is that not interesting to keep offering "big" (in literal sense) drives anymore.

The original post: /r/datahoarder by /u/azurerug on 2024-12-06 11:51:14.

TL;DR: Should I take the deal of replacing my dead HDD’s PCB to have proper SATA connection for 240€/255$, and if the data is still inaccessable, then an extra 120€/127$ to replace the R/W head?

Hey,

I have a WD Elements 1TB external HDD that has unfortunately failed recently. It started to slow down significantly (to the point where indexing a directory would take ~10-20 secs) and then after a chkdsk run it died completely; it spins up and Windows recognizes it, but no data can be read whatsoever (file explorer loads indefinetly and freezes eventually). The head can be heard to move a bit sometimes, but again, no data can be read.

I took it to a data recovery specialist with at least 10 years of experience and very favourable reviews online. The lad seemed very much professional and, as a CS student myself, I could tell that he “knows what’s he doing”.

After him investigating the HDD, he offered the following:

• 240€/255$: replace the PCB to get a proper SATA connection (the drive has soldered micro USB interface; it’s not a regular SATA drive with a SATA-to-microUSB converter attached) + replace the firmware; he suspects “surface damage”
• additional 120€/127$: replace the R/W head if the issue still persists

I have no reason to believe that he would screw me over with unnecessary work and unrealistic prices; still, the world can be an ugly place, so I would like to ask your opinion about the necessity of his offer, his prices and whether I should take the deal or not.

Thanks in advance!

PS.: Yes, I should have made backups of the data; I was planning to after I noticed the drive slowing down. It would have taken ages to do so with those transfer speeds though, thus the CHKDSK part. The rest is history. Too little, too late. Lesson well learned.

The original post: /r/datahoarder by /u/turn_o_boughs on 2024-12-06 10:11:43.

A scenario for your hoarding consideration:

You discover a box of unrecognized hard drives containing tens of terabytes of data. The drives may or may not contain important and irreplaceable data. It will take months or years to sort through the drives.

Do you immediately back up the data according to established best practices (for example 3-2-1) even though there may be nothing of value on the drives?

I am facing a similar, less exaggerated scenario. My proposed solution is to make only a single local backup while I sort through the data over an extended period.

The original post: /r/datahoarder by /u/Behembaba on 2024-12-06 03:26:00.

Hello!

Is there a way to bulk download all my IG saved photos/videos? I've searched and so far I've only seen methods for bulk downloading my personal profile photos. But what about my saves?

The original post: /r/datahoarder by /u/eight13atnight on 2024-12-06 03:01:05.

So I bought these two media proboxes. I knew they didn’t do hardware raid but I stupidly didn’t think to check about macOS software raid. Evidently that can only do raid0 and raid1.

I have 6 x 12tb recertified drives heading my way bc I planned to do 2 x 24tb raid5 setups. But alas I can’t do that plan anymore.

I’m not excited about any of the raid5 hardware enclosures out there. I had a NAS setup since 2015 and frankly I’m just over all the management of those devices. Constant software upgrades and dealing w all the firewall issues. Proprietary OS is just annoying to constant maintain.

Do you think I should just run two X 24tb raid0 drives and have separate backups of them or just return the whole lot and start again? Or maybe I was thinking do two X 24tb raid0 in a single enclosure (2x12tb times two) and then have carbon copy cloner just manage keeping them mirrored. That way I’d have two copies across four drives and I feel a lot less stressed about that. Ofc have a single drive backup as well bc that’s hoarding.

Someone is going to tell me “raid is not a backup” which I get but it’s at least less risky than a single platter kicking the bucket.

The original post: /r/datahoarder by /u/Icecreamrata on 2024-12-06 02:35:21.

Weird question. I have some 300GB or so of photos saved and I would like to organize them into albums with the same theme (Cats, historical photos, ect, ect), but also to have custom tags so I can just search for that as well.

My odd request is that I want to be able to export all of the tagged and organized files with metadata attached so that I could simply import the files if needed on another device that has the same program. (So, computer 1 has program, I organize there, then I back-up my media onto an external drive, and decide to use computer 2 to view it, and can simply "plug and play").

Is there a software that does this?

Thank you so much for all of your help!

The original post: /r/datahoarder by /u/deatheater02 on 2024-12-06 01:54:24.

I mean tell me if I am wrong but I recently wanted to get a docking station for some of ky sata drives (2.5inches) and i came across some with 4-bay and 6-bay docking stations. But these were quite expensive to buy when the only thing they were doing is to connect some drives to my pc (not even raid compatible) and having a teeny tiny fan to cool them. Yes i understand that there is more to it than I see but still a singh internal to external sata converter costs cheaper per peice (that is per drive) than these docking stations. And the worst part is they are not modular, i understand that there would be power issues and heating might too create a problem but can’t power be solved by putting a bigger something (i dont know the word) in the circuit itself ? And can’t a person DIY a fan to solve heating problems? So shouldn’t there be a station that is modular meaning we can add a few ports (not saying unlimited) as a part to the original station? Like we can buy a 4-bay station as a base but it can support up to 8-bay power and we can but 2-bay additional ports which can be attached to the original station via some connection.

Please correct me if I am wrong coz i want to understand this and work on this

The original post: /r/datahoarder by /u/Everbanned on 2024-12-06 00:21:13.

The original post: /r/datahoarder by /u/borillionstar on 2024-12-05 23:18:46.

I thought someone here might have some magic knowledge to help here?

😰 I need help with our workplace's storage configuration. We require maintaining 90 days of NVR/DVR video footage due to certification standards. Currently, I'm using approximately 128 TB of storage, which allows for a maximum retention period of 89 days and 11 hours. Recently, we experienced a system failure and subsequently added more storage. However, the current block size is 32 KB, which limits our usable storage to 128 TB. To fully utilize our installed 130 TB of storage, I need to increase the block size to 64 KB.

I'm seeking advice on how to:

1. Safely copy this data to a temporary location - but where can I copy 128 TB of video footage, without paying a huge sum ? or
2. Change the underlying file partition to 64 KB without formatting the drive and losing our existing data.

Does anyone have experience with this type of storage reconfiguration or suggestions?

My thought around this was to format the remaining ~3 TB with the 64 KB block size and repeatedly grow the partition? The DVR records about 3 TB of video a day, but the DVR automagically keeps on recording, and deletes older files at the other end, so kinda stuck how to handle this here?

Worst case is I wipe and start over completely but I would rather not do this because we have unannounced audits, and a failure that prompted the addition of storage in the first place.

Additional Pertinent info:

Operating System: Windows 10 Enterprise

File System: NTFS 3.1

Hardware:

LSI MegaRaid SAS 9271-8ii 

Physical Size: 145.538 TB

Drive Group 0, Raid 6, Virtual Drive 0, 130.984 TB

The original post: /r/datahoarder by /u/h3lnwein on 2024-12-05 22:55:49.

Hey

I’m trying to build a server. Right now I’m using my PC with 8TB external HDD, but I’m going to shuck it, add few 8-12TB drives. It will be used for photo backup, some old archives, and Plex with transcoding / HDR tone mapping.

So, would n100 be a good choice? I’ve seen ASUS Prime motherboard with N100 but it had 1x SATA only, but I think it had PCI port so I could add some pci-sata card to attach more HDDs? I’ve also seen some motherboard with n100 with 6 SATA ports, can PCI-SATA be also used there for like 10 total HDDs?

There’s also some i3-N305 I think, that’s also being recommended for such cases?

And as far as connection goes, is it enough that I connect it via Ethernet to one of my WiFi meshes? Because my router is in living room, and I have few mesh nodes (3gbps wireless speed).

I plan to run either windows or linux, any case that can hold 8-10 drives would be good. I just want to be able to host Plex with transcoding and having instant and fast access to my files when I’m using MacBook.

For HDDs, I have an opportunity to buy 12 TB Ironwolf, recertified by the producer, with 1 year warranty, for 120 EUR.

The original post: /r/datahoarder by /u/testdasi on 2024-12-05 22:43:39.

I have an 8TB Seagate NAS (ST8000VN0002) that I used in a not-important NAS to store not-important archival data. I remember it didn't have any reallocated sectors 4 years ago or so but I didn't monitor it until last week I saw that it had 8 reallocated sectors. The data on it (6TB worth) was moved out with no issue.

I want to reduce e-waste so I'm tempted to reuse it if possible. Is it wise? At what point do you recycle / throw away HDD?

The original post: /r/datahoarder by /u/TheOneWhoDigs on 2024-12-05 22:32:04.

Hey all, I've been looking everywhere for a definitive answer, and no matter where I look, I get very inconsistent/conflicting information, so I want to know peoples' thoughts.

I have 4x 18tb internal hard drives for my Plex server, and a separate m.2 for the operating system. Is it a windows PC, and I use it only for Plex service and for streaming games from my gaming PC.

As of now, only one hard drive is in use, and it is almost filled.

I want to have two hard drives acting as the storage, and the two other hard drives as a backup for the main hard drives. People say that RAID isn't actually a backup, or a recovery tool, I hear other people say that cloning or mirroring the drive will also pick up read/write errors and won't actually keep data any safer.

So what is the best method for having a redundant backup of large quantities of data? I thought I could use the Windows hard drive manager thing and create two "storage spaces" that would have one hard drive as main and one as a backup for each pair. Am I overthinking things? I just want two hard drives, with two acting as full backups, but idk if that plan is a bad one, given all I've read.

Thank you to anyone with insight.

The original post: /r/datahoarder by /u/nlnl on 2024-12-05 21:47:27.

I got recertified 18tb drives and would like to know what tools I should run on them before adding them to my NAS.

Windows 11

The original post: /r/datahoarder by /u/FinnedSgang on 2024-12-05 21:37:54.

I’ve a bunch of 1 , 2 and 3tb wd red and a single 14TB Toshiba x300 hdd. Can I merge the smaller disks so that the operating system (which one should I use to do this? in case it is possible) sees it as unique and can raid with the larger one without losing space?