It's A Digital Disease!

The original post: /r/datahoarder by /u/medy17 on 2024-12-25 15:20:01.

Accessing deleted NSFW Imgur posts is a bit of a hassle since it requires creating queries for Wayback Machine CDX API and then reading through the JSON. I didn't like that so I made a GUI app with Python and tkinter to do it automatically.

Here's the GitHub link. Feel free to fork and modify it: Imgur Archive Viewer

Current features:

1. Easy downloading of Imgur posts from CDX API.
2. In app previews of recently downloaded files.
3. Batch processing from a txt file (check the beta branch on GitHub)
4. Auto folder creation (check beta again)

Let me know if there any features you would like added :) Enjoy

The original post: /r/datahoarder by /u/asmkgb on 2024-12-25 14:46:15.

Seagate One Touch Hub, 8 TB, External Hard Drive

The original post: /r/datahoarder by /u/asmkgb on 2024-12-25 14:46:13.

Seagate One Touch Hub, 8 TB, External Hard Drive

The original post: /r/datahoarder by /u/AnnoyingRain5 on 2024-12-25 12:45:57.

Hi all! This is probably the most asked question of all time here, but I have the following HDDs:

• 1x 1tb
• 3x 2tb
• 1x 3tb

Some of these drives are a little old (not super old, SMART looks good, but yanno), so some redundancy would be nice, what RAID configuration options should I consider?

The original post: /r/datahoarder by /u/Quirky_Prize2749 on 2024-12-25 12:13:02.

I am planning on getting a 5 bay/10 bay DAS and populating it with 22tb HDD's. im currently on the fence between orico and Sabrent and would like some advice on which would be better especially when it comes to cooling and connectivity.

The original post: /r/datahoarder by /u/fizzy_me on 2024-12-25 11:25:56.

Hi, does anyone know of a tool that scrapes a soundcloud artists page and saves songs + album covers into albums similar to this bandcamp scraper? Thanks!

The original post: /r/datahoarder by /u/GalvusGalvoid on 2024-12-25 10:43:40.

It’s something that came to my mind as i went to museums a lot recently but i never fully appreciated the art as walking and searching was tiring, sooo… are there any projects that try to salvage paintings? I hope art can be immortal.

The original post: /r/datahoarder by /u/ImDankest on 2024-12-25 10:14:29.

So first of all, happy Christmas everyone, it's a rough start for me unfortunately and was hoping someone here could maybe provide some more insight.

So I use a M1 macbook air on the latest MacOS, and had about 400GB of footage stored on an external SSD. I recently purchased a new external SSD so I copied the entire 400GB folder over to the new SSD. It appeared to have copied over successfully, so I deleted the original copy from the original SSD.

I first noticed issues when my iMovie projects weren't exporting and were throwing errors due to corrupted frames. I noticed when playing back the iMovie projects, there are loads of skips in the videos showing black frames. I thought this was just an iMovie issue, I also moved my iMovie library across to the new SSD.

I then noticed that when trying to play any of my original source video files from the new SSD, these skips and stutters in the video are still apparent. Happens in Quicktime and VLC. In Quicktime the videos stutter, and in VLC there are loads of visual artifacts in the videos. The audio continues to play fine, just issues with the video playback.

I am unable to edit with any of this footage due to these corrupted frames. I'm actually devastated, this was years of personal footage which is can't just replace.

Is there anyway to salvage this? Any ideas what may have caused this in the first place and how to prevent it happening again?

The original post: /r/datahoarder by /u/mialululu on 2024-12-25 08:52:43.

https://preview.redd.it/zlkrwxgvky8e1.png?width=1381&format=png&auto=webp&s=4d74b32cd42b8472c064bd66a439ef2812c75de5

View Poll

The original post: /r/datahoarder by /u/sharma1804 on 2024-12-25 08:22:48.

iCloud+ | Primarily for backups of Apple Devices i own.

SanDisk Type-C Flash Drive | 128GB to transfer temporary files between computers. (Nothing important stored).

Samsung T7 SSD | 2TB. for my work, i am not creative professional but i love having the data i access most on this drive.

WD MyBook | 14TB. for backups of everything.

Amazon Glacier Deep Archive | Final backup of MyBook.

WD MyBook is mainly used to backup all of my files. & Glacier is what i use for final backup solution.

The original post: /r/datahoarder by /u/Widowshypers on 2024-12-25 08:14:49.

The original post: /r/datahoarder by /u/DaNReDaN on 2024-12-25 05:18:38.

I would like some advice making an ideal backup system for a new DAW (digital audio workstation /music production) with 3 bootable copies of the system drive.

Why three bootable copies?

Due to how DAWs handle files, simply backing up projects and files isn’t enough. The system also needs copies of every installed plugin, all samples, and every recorded audio track used by projects.

Rebuilding a DAW from just the project files is a nightmare I want to avoid.

Current System

Currently I use Backblaze, but it doesn’t back up system files. So, I have a second drive with scheduled ISO backups of the system drive which are then sent to cloud storage.

However, this isn’t ideal in Australia, as even the fastest 1000Mbps NBN plans have only 50Mbps upload speeds. Uploading an entire ISO takes too long, making it unlikely that the most recent ISO is backed up if my PC is destroyed.

Backup Goal

I want the 'holy trinity' of protection, but each of the three copies need to be bootable, lest I suffer for many hours in case of a fire that burns my pc to the ground.

The new PC will have a 4TB NVMe system drive and I currently see a few options for backup but am unsure which combination is best or if there are other options that would suit.

4TB NVMe Backup Drive

A mirror of the system drive. Immediate mirroring isn’t essential, as losing a day or two of work isn’t catastrophic, as long as its bootable.

Questions about this drive I have would be:

1. Should this drive mirror on a schedule (ie. end of the day) to make sure its bootable in the event of a non-hardware issue?
2. Can this drive be a slower/more affordable drive than my system drive?

8-16TB HDD for ISO Backups

Stores scheduled ISO backups of the system drive.

Having this would also allow keeping 2+ historical ISO images in case the latest one has issues. This ISO could be uploaded to cloud, albeit slowly. Unsure if internal or external would be best practice.

Cloud Storage with Bootable Mirrored Backups

Looking into cloud services that support bootable mirrored backups.

Concerns

Looking into cloud services that support bootable mirrored backups, if it only keeps a recent mirror could the backup also just replicate a potential software issues? Having one or two historical, bootable backups would be ideal but unsure if possible or essential without backup of whole ISO's.

Are there other options I have not yet discovered that would suit this build?

If anyone could shed some light on what an ideal backup system in my case might look like, that would be much appreciated.

Thanks!

The original post: /r/datahoarder by /u/kaitlyn2004 on 2024-12-25 05:06:34.

It seems this is not really a thing, or I'm not looking for the right thing. Anyone know if this exists, or what might suit my needs the most?

Currently looking for an alternative to my external 3.5" drive to plug into my laptop dock to a) be quieter; and b) faster. I'd really prefer to not have to plug them all in individually and have macos combine them.

The intention is this external drive would then become the backup disk. I need minimum 8TB+ space, and I was thinking of 3 or more 2.5" 4TB SSDs which seem the best value option right now? So given they would also be backed up, plan is to have all the disks show up as a single volume and just span the space across the disks?

NVMe still just seem at a premium right now that I'm not sure it's worth it... plus I don't actually need THAT speed. Also with something like 4 in an enclosure, I'd worry about the heat and degradation that way.

I've always used a NAS as my backup device. I suppose I could look more into NAS as the file server too... though then I'd be looking at > 1gbe port or upgrade... and a new 4-bay nas is just so expensive to start with!

DS923+ (seems most recommended?) + upgrade card + (maybe upgrade ram?) + disks... yeah...

The original post: /r/datahoarder by /u/guarayos on 2024-12-25 05:05:10.

I've been looking for a way to expand my storage for a project where I "need" about 200 TB and yadda yadda yadda I don't like existing cases, so here's my design: The Milk Crate DAS.

Two milk crates filled with HDDs, fans, a PSU, and a SAS expander

It's cheap. $8 a piece of the two milk crates (I like the real ones, not the flimsy crap they have at the discount store). The design has blocks of 8 drives mounted vertically with 2x 120mm fans on the bottom and 2x 120mm fans on the side.

The plan is to build the first part which includes one HDD block and the PSU and SAS expander and then connect the second which has just two HDD blocks.

I think I'll probably zip tie the two crates together to reduce the chance of cables being pulled from the SAS expander.

The whole thing should be stackable. Cables in to the pair are: 1. Power cable, 2. Two 8644s from the HBA on the main NAS, and 3. Optionally a single 8644 leaving the pair going to another pair with another 24 HDDs. Yikes! Cables going between the two crates are: 1. Two SATA power chains, and 2. Four 8643 to SATA cables.

I had designed some more fancy cases but the cost of the 3030 extrusions and rails and stuff was approaching the cost of a used NetApp so I figured I'd first start with this and put my extra money towards a few more used 12TB HDDs.

The original post: /r/datahoarder by /u/PrettySmallBalls on 2024-12-25 05:03:49.

Figured this might be the place for this question. I picked up a couple 14TB Seagate Expansion externals for shucking on Black Friday. These are the ST14000NM0121 dual actuator SATA drives. I read if I create two equal partitions and set them up as RAID0 I can significantly increase read/write speeds. My tests seem to confirm this. My question is, is there any advantage to setting them up as two equal partitions and forgoing the RAID0 part? If they're RAID0 and one of the actuators fails I know I'm dead in the water. If I have them as two separate filesystems and an actuator fails, can I still access the other partition?

The original post: /r/datahoarder by /u/NaturesEnigmax on 2024-12-25 02:01:38.

it's not me being impatient, any time i submit a youtube link to be saved, even after days of waiting it's still not archived. i know about the hack and all that but that's irrelevant because this has always been an issue for me.

The original post: /r/datahoarder by /u/New-Draw-6058 on 2024-12-25 01:17:22.

The original post: /r/datahoarder by /u/Virtual-Guitar-9814 on 2024-12-24 23:50:53.

the images on wayback machine are slow to load so i thought an automatic tool which downloads the images would save a lot of time. does it exist?

The original post: /r/datahoarder by /u/CBniteowl on 2024-12-24 23:10:17.

Now with 4 computers in our home. This month I noticed I started researching what I used to assume was Snake oil (gimmick) software. I'm wondering what tools I should invest in. Like partition managers to bare metal windows and Linux backup images, to all the classic Smart and chekdisk type tools.

Looking to move our systems to SSD drives is what got all this thinking started. Also related to data loss prevention.

Backups: if I did a OS backup or a partition backup. Is the image that's backed up also storing all that empty space that's in that partition? Or is it shrunken down to the image backup only being the size of what data was used in that partition?

Which if the backup does copy even the empty unused space. Then the smthought of making new partitions for the main OS being changed so when I did do a partion image. The stored backup would be smaller.

Haha since IDE hard drives. I always felt letting things stay natural was better. So I never compressed a drive for space or even messed with partitions.... Till now.

I understand the differences with just transferring a OS from a HDD to a SDD. But Id like to back up our OS'es so when the need to restore or upgrade anything came about. It would be way less hassle than reinstalling stuff you forgot you ever installed or tweaked.

LONG STORY SHORT: Any good utilities for the to invest in for this families growing tech uses.

I remember Paragon and Acrinis used to be big names. But since I real a lot of negative reviews or glitches. Yes I'm old. Any suggestions?

The original post: /r/datahoarder by /u/megaladon44 on 2024-12-24 22:05:45.

So i have to have all my desktop docs eetc follow me and sync to all my pcs under the onedrive folder?

I dont know why i find this so annoying.

Does anyone have a way they use onedrive that makes sense???? Like maybe just have it as a single folder that isnt a part of the user locations?

The original post: /r/datahoarder by /u/esdarom on 2024-12-24 21:45:37.

Hello,

I need help building a custom NAS for a small local library on a somewhat limited budget. They have provided me with a list of requirements, but I’m unsure about the best way to approach this in terms of hardware and software. I’m considering software like Unraid, TrueNAS, OpenMediaVault, or Rockstor, but I’m open to other suggestions. Alternatively, I could use a Linux distribution and manually configure the necessary NAS-specific packages.

Below are the detailed requirements:

Software Requirements

• Package Installation: The system must support typical Linux package installations, with specific needs for:
  • OCRmyPDF (for OCR tasks)
  • ripgrep-all
  • qgrep
• RAID Support: Ability to configure and manage RAID0, RAID1, and JBOD setups.
• Remote Backup: Capability to perform backups of all storage pools to another NAS at a remote location.
• SSH Access

Hardware Requirements

• OS on a Dedicated SSD: The operating system should run on a dedicated SSD for better performance and separation from the storage drives.
• Initial Configuration: The system will initially include four hard drives configured in JBOD but should include more positions, for additional hard drives to be added in the future.

I’d appreciate advice on:

1. Choosing the most suitable software or operating system.
2. Recommendations for compatible hardware components (e.g., motherboard, CPU, RAM, power supply, hard drive racks, etc.).

Thank you for your time and suggestions!

The original post: /r/datahoarder by /u/Dizzy_Ad8594 on 2024-12-24 20:52:56.

I've got a large and growing digital footprint of photos, videos and various other precious data. It's a bit all over the place between outboard hard drives, previous retired computers. Roll into that iCloud and Dropbox and it's a bit of a mess to say the least.

I'm looking for a good solution to do two things 1) get everything together especially the photos into one place; 2) once that's done, having a manageable backup solution. I'm considering a pair of 20TB wd usb enclosures so one could be stored off site and swapped monthly. I think the full size of everything is about 10TB so this would give me some growth room. The whole system is mac based. I'd appreciate advice on how to go forward.

The original post: /r/datahoarder by /u/ewlung on 2024-12-24 11:17:06.

I need online storage to back up my data (photo, video, files). Total size about 1.5TB. After some reading, I thought Google One 2TB (100 euro/year) would fit the needs.

I do have already Google One 100GB, but so far, I only use it via my Pixel phones. I have never used Google One from PC. From what I read, there is Google Drive for Windows which I can use it to sync.

If you use Google One for online backup storage, is it reliable? What are the hidden caveats or things that I should know?

Note that the purpose is just for backup. At first, I wanted to use Backblaze B2 pay-as-you-go ($6/1TB/month), but Google One is a bit cheaper, and I can use it also for our phones photo backup.

The original post: /r/datahoarder by /u/cmdrmcgarrett on 2024-12-24 23:01:49.

I am thinking about getting a rack server to place all my hard drives into using a Xeon cpu of some kinda.

Is there a way to just install a monitor, keyboard , and mouse in my kids room and have her use Windows installed on the server and be able to play games on the server while it is in the basement and her room is on the main floor?

What would I need to be able to do this?

The original post: /r/datahoarder by /u/DeadoTheDegenerate on 2024-12-24 19:14:08.

I've been browsing around amazon a little bit looking for decent PCIe card --> SATA port options, but for some god forsaken reason, I can only find comically large 1x cards (I found a PCIe 1x to 16 SATA... SIXTEEN!), yet the highest amount of ports I can seem to find on an x4 card is six...

Anyone got options, ideas, better places to look, etc? May alternatively go for a PCIe 4x --> 2x mini SAS, then break those out to 4x SATA drives each, but the only ones I've found on Amazon have been like £100.