The original post: /r/datahoarder by /u/asblade_ on 2024-12-11 15:41:29.

---

Hi All

So, I want to store a large quantity of data (photos, PDFs, video/ audio files, etc) in the most permanent way possible. Since it will be nothing that needs access all the time, I was aiming for something cheaper than one of those NAS systems. My initial idea was multiple high-capacity HDs, perhaps in a RAID. I considered media like blu-rays but I think it would be needed a huge amount of disks. Not be space efficient...

I am running out of ideas....I considered media like Blu-rays, but I think it would need a huge amount of disks. What does the hivemind here suggest?

The original post: /r/datahoarder by /u/vghgvbh on 2024-12-11 14:09:34.

---

First of all: Thank You for all your help in advance!

I work voluntarily for a non-profit youth-club in my neighborhood.

At the beginning of next year, I will be taking on the role of chairman for our organization and wanted to address the procurement of new PCs for our association, funded through donations we have received.

One of the items on my to-do list for next year was to purchase 20 lifetime licenses of Macrium Reflect Workstation. The plan was to implement a scheduled weekly incremental backup of each PC locally and then automatically sync it to the local NAS via Syncthing.

However, my plan has now been destroyed as Macrium switched to subscription base only and is demanding over €1,000 annually for our setup year after year. Which we cannot afford.

So. What can we use now, for our use-case?

I always favored Macrium until now, because I made good personal experiences with it at home, and it always worked flawlessly for me.

Please note that we do not have a network administrator or similar expertise available, nor can we afford one. Our team consists of volunteers with some technical background, and our hardware setup is relatively simple: a basic NAS, twenty PCs and laptops, and some peripheral devices.

This context makes it even more important for us to find a straightforward and user-friendly solution that can be managed with the resources and skills we have at hand.

The original post: /r/datahoarder by /u/Visible_Bake_5792 on 2024-12-11 12:16:48.

---

SSD are much more expensive than last year, at least in Europe. I found a 4 TB SSD on Ediloca web site. The price was low, I tried it. The SSD works and I tested its capacity with f3write/f3read, all good.

But it appears to have a quick 1TiB Flash zone followed by the remaining 2.7 TiB / 2.9 TB in slow flash.

(See https://en.wikipedia.org/wiki/Byte#Multiple-byte_units for difference between TiB and TB)

Speed varies with the file system and mount options, anyway I managed to reach ~ 350-400 MiB/s on the first TiB and then 50-60 MiB/s on the remaining space.

I asked the support if they had some clue: magical mkfs or mount options, firmware upgrade... They just told me that all SSDs are like this, and I should wait ~ 15 minutes until the quick zone recovers. I suspected that this was untrue, anyway I tried writing 250 GB files and wait half an hour between each file. Same result!

Has anybody seen a similar behaviour? Is there something I could do to make the performance more constant? I tried mounting a BTRFS filesystem with ssd_spread, that was worse (just slower everywhere).

My last test, with redundant or verbose lines suppressed. It was running on a N5105 mini PC with 16 GiB RAM. I previously tried on another machine with an utterly different SATA controller, and got the same results.

# mkfs.btrfs -f -d single -m dup --csum xxhash64 -O extref,no-holes,block-group-tree,free-space-tree,squota /dev/sda1

# mount -o ssd,lazytime,nobarrier,nodiratime /dev/sda1 /m/

# for I in 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 ; do

sync; date "+%s $I" >> /tmp/ssd.log;

dd if=/dev/zero of=/m/$I bs=128k count=1907349 status=progress

date "+%s $I" >> /tmp/ssd.log ; sync; sleep 1800

done

250000048128 bytes (250 GB, 233 GiB) copied, 711.98 s, 351 MB/s

# There was some activity on the machine, dd probably fight for the buffer cache with other processes on the first file

250000048128 bytes (250 GB, 233 GiB) copied, 550.064 s, 454 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 629.865 s, 397 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 541.539 s, 462 MB/s

# All this was written at full speed, 1 TB = 932 GiB

# It seems that the quick zone is 1 TiB, so there is still # 1024-932 = 92 GiB in the quick zone

250000048128 bytes (250 GB, 233 GiB) copied, 2097.48 s, 119 MB/s

# This speed is consistent with 92 GiB at full speed and 233 - 92 = 141 GiB at slow speed

# All the remaining files were written at slow speed.

250000048128 bytes (250 GB, 233 GiB) copied, 4228.37 s, 59.1 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3756.49 s, 66.6 MB/s

# At some point I run "fstrim -v -a" just in case. BTRFS should TRIM the SSD if needed in the background (discard=async)

# fstrim did not help

250000048128 bytes (250 GB, 233 GiB) copied, 3731.19 s, 67.0 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3823.29 s, 65.4 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3852.8 s, 64.9 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3789.42 s, 66.0 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3870.74 s, 64.6 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3847.66 s, 65.0 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 3997.83 s, 62.5 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 4095.57 s, 61.0 MB/s

250000048128 bytes (250 GB, 233 GiB) copied, 4169.98 s, 60.0 MB/s

In the end:

# df -h /m

Filesystem Size Used Avail Use% Mounted on

/dev/sda1 3.8T 3.7T 75G 99% /m

# ls -sh /m

total 3.7T

233G 1 233G 11 233G 13 233G 15 233G 2 233G 4 233G 6 233G 8

233G 10 233G 12 233G 14 233G 16 233G 3 233G 5 233G 7 233G 9

#

The original post: /r/datahoarder by /u/Frequent-Student-346 on 2024-12-11 11:05:02.

---

Hi Guys!

I think I have found the right place to come with this items that I have.

Not long ago I bought alot of stuff for very little from someone.

And In those itms there are a bunch of:

Data Cartrige 160/600/800/1.6TB.

HP StorageWorks 160 and 1840 drivers(Were you use the data cartrige)

And a lot of HPE HDD Hard Drives 146/500/600/1TB .

They are all new/sealed in there original packaging. Some open box.

I live in Europe. So I'm looking for buyers that are interested in buying in bulk.

And maybe some help from people here with prices. Thank you!

The original post: /r/datahoarder by /u/harperthomas on 2024-12-11 08:40:35.

---

I recently bought the Terramaster F4-212 4 bay NAS and it has been a nice plastic paper weight. It took 4 days to build the initial RAID with 3x 8TB drives, then another 4 days after adding the 4th 8TB drive to reconfigure. Then when I finally tried to expand the storage pool for the new drive the system crashed and I had to reinstall the OS. Since then ive been going around in a circle with the system crashing, reporting raid degradation errors, but all drives showing as healthy and now I cant even access it once again. Probably another fresh OS install.

Rant Over.

I setup the drives in ext4 RAID 5. Im still in the return window for the Terramaster so if I buy a new NAS from another brand, will I be able to slot my drives in and get everything running without reformatting the drives / losing data? I dont really have a backup option here.

I am looking on Amazon and the next cheapest option is the Asustor Drivestor 4 AS1104T. Is this going to be a better experience than the Terramaster? I dont have much money so please dont suggest I get the latest $1000 synology as its simply not an option. The QNAP TS-433-4G is the next cheapest ive found but I dont know if i can afford the price increase over the Asus.

The original post: /r/datahoarder by /u/CodexFive on 2024-12-11 07:02:38.

The original post: /r/datahoarder by /u/BanhmiDev on 2024-12-11 06:46:34.

---

Does anybody know a good place to buy refurbished HDDs?

I’d use them only for temporary storage, so non-critical data, but I’d hope it would last at least a few years (obviously a gamble anyway). Also, does the standard 2 year warranty not apply on refurbished products? Seen on Amazon that they offer a 1 year warranty on refurbished products.

The original post: /r/datahoarder by /u/Ripcitytoker on 2024-12-11 05:21:40.

---

I read that backup hard drives should he replaced every 3 to 5 years, but I wonder if this still holds true for hard drives that are just used for archibed storage and not day to day backups. Does anyone have any insights into this?

The original post: /r/datahoarder by /u/theBloodShed on 2024-12-11 02:05:05.

The original post: /r/datahoarder by /u/malwarebuster9999 on 2024-12-10 22:54:24.

---

Hi. I wanted to ask what the best way to archive a steam game is. One of my favorite old steam games is going to be ending sale at the end of this month. Even though the developers promise that those who have purchased the game will retain access, I want to ensure that I will have the game archived, and that I can send it to other people, so I can still play self-hosted multiplayer. Do you have any recommendations?

The original post: /r/datahoarder by /u/cuteprints on 2024-12-10 15:20:15.

The original post: /r/datahoarder by /u/Bobby50371 on 2024-12-10 13:19:40.

---

Hi there, without breaking the bank, I am looking for recommendations on a to Drive hard drive enclosure that supports red one that can hook into my wife’s MacBook Pro. She has a 1 TB internal and I have 24 TB drives I’d like to mirror for redundancy so she can do her time machine. I have spent five hours collectively in the last three months trying to find driving closures and of course I get to the reviews and there’s always somebody that says do not buy this drive or data is corrupted or enclosure ruined my drives. I would just like something cheap that I can plug in these two hard drives so that she can save all of her back ups because I am running out of server space for her. TIA.

The original post: /r/datahoarder by /u/ImTheWorstPersonToBe on 2024-12-10 12:53:29.

---

Ive been wanting to turn some old 2.5"ssd's into a (preferably) NAS but will be okay if it's a 4bay to usb.

I've been looking around and I found 4bay nvme, or 3.5" hdd. Am I missing something ?

Ide prefer not to sled the 2.5 into a 3.5, it's very over sized and very bulky looking and I really have limited space.

The original post: /r/datahoarder by /u/mdknight666 on 2024-12-10 08:08:23.

---

I have an old mediasonic probox 4bay hfr2 3s2, and noticed that there is no true power switch (it's some kind of electrical relay instead of a mechanical switch), and I can't change the fan speed after it's plugged into a PC, but if I disconnect the usb cord the manual fan switch button works. Another thing is that I noticed I can't eject the drives, unlike my other storage boxes from sans digital, etc.

I found this quite risky as I don't like to power on my drives unecessarily, and I like to power them down when not in use.

I noticed mediasonic has a new box design released in thr last 2 years. Did they improve on this, besides the usb 3.2 speeds?

The original post: /r/datahoarder by /u/justfindaway1 on 2024-12-10 08:00:25.

---

I have a 4 slot fantech jbod. I put 3 small hdds in it. I use it for my sacrificial old drives for downloads, p2p, etc.

Despite being usb 3 (dont ask me what rating / speed / yearly-changing nomenclature), it can't transfer files quickly, and trying to do transfer operations from more than one drive at a time will tank the transfer speed of all but one to next to nothing.

30-50MB/s in the best case if I'm reading from one drive to write on a disk that is not in the JBOD a large file. I've almost managed 80-100 from one jbod disk to another for a large file while doing nothing else. I'd be more than happy with 40MB/s.

However this is the best case scenario and it's almost never the case. having jdownloader and torrent operating (my internet speed is about 5MB/s) slows this down, and most importantly, trying to do one transfer from one disk and another transfer from another disk will result in the transfer speed to a more typical 5-12MB/s while the other will be at 100kbps. to move a completed torrent to another location takes much longer than it should even if I'm not doing other transfers (but while I'm downloading other stuff)

Is it an actual matter of transfer speed? Did they skimp on the controller and it can't handle the disks at once or the transfers? do the write operations weigh too much on the jbod or the disks to allow transfers too?

The original post: /r/datahoarder by /u/sunnyofitaly on 2024-12-10 06:46:05.

---

Anybody know a place that's still up?

The original post: /r/datahoarder by /u/better_life_please on 2024-12-10 05:57:43.

---

I'm low on budget (100 USD). I've got some half a TB personal files I don't want to lose.

I've stored them on a 1 TB portable HDD for the last several years. I can't trust it because I'm afraid it'll fail some day (but it still operates well).

I have found several choices so far:

1. Get a portable 1 TB HDD
2. Get a 1 TB blue WD 3.5" HDD with an enclosure (not a great value for money)
3. Get a 4 TB desktop HDD (Seagate Expansion or WD Mybook)
4. Build some kind of cheap NAS system

I don't have access to a PC though. Only Linux laptops (I'll probably use ext4 or btrfs). And I won't move the drive out of my room. I need one only for in-house use.

So what's the better approach? Does any other solution exist?

The original post: /r/datahoarder by /u/fixeditgood on 2024-12-10 05:55:39.

---

Hey everyone,

 I recently went off the deep end and bought a sight unseen HP G2 1/8 LTO6 autoloader [ok that’s a lie, I went off the deep end long ago]. Terrible decision as I am aware of HPe’s lack of any sort of support without a support contract. The issue of course I’ve run into, ironically and surely enough is I don’t know the GUI/control panel pin/password, and there is no handy dandy reset button. Seller has no idea about anything technical, so no help there. I did a fair amount of googling, and stumbled upon a 10+ year old spiceworks post explaining how to calculate a special code for a HP 1/9? 1/8? idk... (see below link), but either I can’t do math properly, or it isn’t working for one reason or another. My autoloader accepts 8 digits number ranging from 0 to 9 for each digit, the post indicates that the password on the autoloader generation there only has numbers 1-4 being valid... hmm.

 

https://community.spiceworks.com/t/hp-autoloader-1-8-g2-magazine-password-issue/65280

 

Has anyone had any experience resetting the password on these using the calculation with the date and time?

 

Thanks in advance!

 

The original post: /r/datahoarder by /u/waaaggh on 2024-12-10 05:51:25.

---

Hey guys I'm looking to have a permanent long term storage solution for my business. My research into this yielded the following and I wanted to see if you guys have any recommendations.

I edit on my Macbook Pro off a 4TB Samsung T9 SSD. My shoots net about 500gb per job and I do plan to keeping my RAWS and footage forever. In the wedding industry it's probably best to never delete anything. Most likely I'll be compressing my RAW files to lossy DNG sometime in the future unless I just buy more HDDs.

I keep a old gaming PC running 24/7 and would ideally use a DAS so I can use Backblaze's backup service as an offsite cloud solution. The desktop just runs Windows 10 and I already have four 4TB drives inside as a Storage Space volume hosting my own personal files. They are setup with parity which as I understand it is basically just RAID 5.

During the black Friday sale, I bought four Ironwolf Pro 16TB drives and a QNAP TR-004. I have since set it up in hardware RAID 5 and just plugged it into my desktop.

My plan for data workflow:

1. All my cameras run dual SD or CF-Express cards
2. When I get home, I copy my memory cards to the T9 SSD and over my network (just a pleb 1Gb/s network) to the QNAP DAS network drive on my PC overnight
3. Backblaze backs up everything to the cloud off the desktop
4. I edit off the T9 SSD and keep the files on the T9 until final deliverables are sent. I rarely work on more than 5 jobs at once so the 4TB has been working fine for me
5. Once or twice a year I plan on dumping the files off the DAS onto an external USB HDD and just buy more of them as I fill them up as an onsite backup. At the current 43TB off my DAS I'd eventually buy 4-5 USB HDDs.

This setup give or take some complexity is what I've seen other photographers using for long term storage. Some others use a NAS but then you'd loose out on the cheap Backblaze backup and I don't edit off these drives so I shouldn't see much benefit of a NAS right?

Is this a solid solution for my use case? Any recommendations and tips?

When I was learning about the different RAID options some people have said RAID 5 is bad. Should I use something else?

Is there a better enclosure that you guys would recommend? The QNAP seems to be one of the few hardware RAID enclosures I've found. I don't foresee having to move the enclosure to a different computer too often but that would be the main advantage of the built in RAID controller. In case my desktop dies or has issues, this seems to be the easiest solution to still have access to my DAS instead of fixing/buying a new desktop.

Would a software controlled dumb enclosure be better than the QNAP TR-004 as far as reliability? If the enclosure dies do I have to rebuild the RAID and loose all my files in either a dumb enclosure or the hardware raid one?

So many questions as I delve into this rabbit hole of long term data storage. Really appreciate any insight!

The original post: /r/datahoarder by /u/Successful-Bet-4746 on 2024-12-10 05:33:04.

The original post: /r/datahoarder by /u/sodaarchan on 2024-12-10 05:21:20.

---

This is how I backed up all my files on a budget

I have 4 raid1. 2-3 tb per raid (2 drives per raid). Each raid contains files by year. Make raid through MacOs Disk Utility

Plug in only when to backup. I guess it called "cold storage"

And I create a catalog of the files inside after backing them up each time, so I can see them whenever I want.(just see, no access)

Any recommendations to make it better? or it's all good

The original post: /r/datahoarder by /u/Blaising_Lion on 2024-12-10 04:49:27.

---

Hi y’all. Quick question here. I recently bought the QNAP TR-004 and am using it as a DAS for my PC, and so far it’s great. I happened to read up on improved data transfer speeds through use of a USB-C cable, and thought an upgrade for my current cable would be a good idea. When I looked into it, a few different options came up, and some of the higher speed ones looked especially enticing (like the USB4 cables that boast extra high speed). However, I’m trying to determine if the QNAP can handle those, or if I’m better off making a smaller jump to just the 10gbps cable. Any advice is appreciated - I’m rather new to working with DAS devices.

The original post: /r/datahoarder by /u/SpicyWangz on 2024-12-10 04:08:07.

---

I'm planning on setting up a NAS at my home. I was thinking about getting a Synology DS223j for something basic, but for about the same price I could have a N100 Mini PC and USB HDD enclosure. Way more power with not much more power consumption.

I'm only going to have 2x4TB Drives in RAID 1 in the enclosure. If I throw a 6TB external drive on the Mini PC too and schedule it to backup the drives from the RAID enclosure is there really anything that can go wrong? Is the main concern going to be data is lost via the USB interface itself?

The original post: /r/datahoarder by /u/Makegooduseof on 2024-12-10 03:06:48.

---

One of my SSDs (m.2 type) attached internally to my laptop suddenly disappeared from Explorer, and when I restarted and entered BIOS, it did not show up.

I found some tip online saying to leave the PC on BIOS for half an hour in order to revive SSDs, and that actually worked. I took the opportunity to copy away all my files off that problematic SSD.

RMA time? Or was that a connection hiccup?

The original post: /r/datahoarder by /u/SLJ7 on 2024-12-10 02:00:27.

---

I need to hook some hard drives up to a mini PC, and I found this five-bay enclosure on Canadian amazon. It claims it supports all the RAIDs, but I'm a bit confused on whether that just means it passes the drives through and allows you to do whatever you want with them, or if it comes with some kind of onboard RAID.

If it does come with onboard RAID, am I right in thinking simper is better and I should just get something that passes the drives directly through? Does anyone have a recommended brand for that? I could probably be okay with four bays, though more is better. The Ugreen one caught my eye because I've been using their chargers, cables, docking stations and power banks for a while, and everything seems to be reliable so far, but data is a bit more critical than any of that and I've heard mixed reviews of their quality from other people.

Thanks muchly.