It's A Digital Disease!

The original post: /r/datahoarder by /u/poseidoposeido on 2024-12-27 14:41:29.

Ok, this is my setup: 3 Synology Nas: ds211j (useless), ds214se and 215+, this las 2 have 2 2tb disk each one, in raid. (So 2tb usable space on echa nas) I want to migrate to a 4 bay nas, and as I'm tight on budget I'd like to reuse my HDD.. but what to do with the data during the migration? My idea is to upload the data to cloud services (2 differente like crash plan and black blaze) move the disks to the new Nas, and download from the cloud. Am I crazy? Is there a better approach that does not include purchasing new HDD?

Thanks

The original post: /r/datahoarder by /u/KeyDifference4178 on 2024-12-27 14:13:14.

The original post: /r/datahoarder by /u/LeviAEthan512 on 2024-12-27 13:57:23.

From what I can tell, it's all 99% good. Just some oddities that I think are inconsequential, but I'm new to this so I'd like to make sure.

The programs I used are Crystal Disk and Quick Hash.

I pasted 278 copies of the largest single file in my PC to see if they all have the same hash, which should tell me beyond a doubt that all files really are fully written and not overwritten. Right?

So the hashes are the same across all copies, except for two ranges, and both ranges have the same hash. Most files hashed to 6B7... but some hashed to B01... Those B01 files are all in two contiguous ranges, 15-35 and 183-192. I named all the files name(1), name(2) etc etc. Any possible reason for this? Or is it perhaps just one bit off that no one cares about?

Based on time modified, the B01 files were copied from my SSD in the HDD, and the 6B7 files were copied from the HDD back into itself. Is this sort of copying, same drive to same drive, known to flip a bit somehow?

As for Crystal Disk info, again all looks good, Just some... 'metadata' type stuff is different from expected.

All my drives follow some revision of ACS standards, but one of these new ones is "ATA/ATAPI-7 | ----". I've read these are basically the same, but is there any information that can be gleaned from the difference? Like maybe, was this ATA drive made in a different country, where the custom is to mark it as ATA instead of ACS? Also, the transfer mode is "---- | SATA/600" instead of "SATA/600 | SATA/600" that I'm used to. I assume this is a minor error in whatever records the drive's characteristics. But is it a sign of worse to come?

The original post: /r/datahoarder by /u/BadongkaDonk on 2024-12-27 13:52:49.

Mostly videos around 1.5GB

The original post: /r/datahoarder by /u/TheHoxy on 2024-12-27 11:28:59.

I currently have a Gaming Laptop that only has 3 USB ports (2x USB 3.0 Type-A and 1x USB 3.0 Type-C)

I'm on a tight budget so I'm looking for DIY options of connecting as many of the HDDs I have as possible through 1 or 2 USB ports (considering I'm using the last one to connect peripherals)

I have tried cheap USB hubs but of course not enough power to connect so many HDDs at once, I'm currently using Onten UCA9701 for peripherals (mouse, keyboard, gaming controller) on the Type-C port and a powered USB Hub Onten UCA312 for 2 HDDs (tried and it can't run a 3rd one) on one of the Type-A ports and the last port is just a SATA to USB cable for 1 HDD, for a total of 3 HDDs at once

I realize my setup is basic and some even warned me of dangers of connecting too many devices at once on USB because there is a lot of power draw so I want to upgrade but I'm not sure what would be a good and at the same time cheap step to take here

I did find things like this Sabrent DS-4SSD, and I even found this USB 3.0 to 5 SATA that I can use alongside this Power Supply board (I can get an empty case from work and setup the HDDs in there if I get everything) but I'm not sure about the legitimacy of the website for the SATA board and that is not a small amount of money I can move without knowing if it will be a good investment option

I'm open to any number of suggestions whether it be better USB Hubs, DAS tutorials or even as a last resort NAS tutorials (While I do prefer USB for better connectivity since the router I have isn't very fast and there is some latency but if it's the best option I will switch to it)

The original post: /r/datahoarder by /u/yed_kriz on 2024-12-27 10:19:56.

Hi, I'm planning to do 1:1 copy of Bluray movies using 50 gb BD-R. I know there are 25gb bds available with compression but I need it to be exact copy. What will you suggest? Here in India the amount of bd are 12 USD to 100 USD and I think cloning is more ideal, though, correct me if I'm wrong. I do love to have a phisical copy instead of streaming in any kind. What are the sources for ordering in bulk quantity like 200 BD-Rs? I found some suppliers in china and not sure on their quality. And there will be custom charges as told by one of the supplier from China. For local suppliers of Verbatim, it's about 50usd for 20 in jewel box cases.

Pls share your suggestions and thoughts.

The original post: /r/datahoarder by /u/Monk_Significant on 2024-12-27 07:04:35.

I use my NAS for storage and video editing only and currently have a Synology DS1821+ with x8 16tb drives with RAID 10 set up connected to my x2 PC's via 10GB connection.

I'm now looking to get something faster (and quieter) for additional storage (but keeping the DS1821+ running still) and have had my eye on the Flashstor 12 bay GEN 2 now its out but want to make sure I'm making the correct decision as its not a cheap outlay.

My PC motherboards will still use the sole 10GB network connection with the DS1821+ but the motherboards also have x2 Thunderbolt 4 USB Type-C ports meaning I could connect the Flashstor via Thunderbolt to each PC still (as the Flashstor has x2 Thunderbolt connections).

I don't know that much about network/NAS set ups and i just want to set up things once, then just use it for storage and video editing and nothing else, so...

1. Will the Flashstor offer faster speeds when connected by Thunderbolt instead of 10GB ethernet for copying big files and dragging video files from the M2 NAS direct to my video editing software timeline?

2. What is an ideal RAID type for an M2 NAS where I don't need RAID 10 like on my DS1821+?

I just want the fastest speed and maybe just have a couple of drives spare for protection to give me the max amount of storage when filling all x12 bays.

The original post: /r/datahoarder by /u/denierCZ on 2024-12-27 13:05:20.

The original post: /r/datahoarder by /u/londoner13 on 2024-12-27 11:49:47.

The original post: /r/datahoarder by /u/666hawk666 on 2024-12-27 11:41:13.

I downloaded entire wikipidia page (about 100 GB) which is in .xml, any idea to open it. i tried many browser and notepad and office and i couldnt. any idea ??

The original post: /r/datahoarder by /u/-ThatGingerKid- on 2024-12-27 08:23:41.

I'm very confused, I've received about a bazillion different takes on what is permitted in Cloudflare's ToS.

So, if I have a media server and I want to make it accessible to the outside world via a web domain WITHOUT port dorwarding or a VPN, my understanding is that i can do this with a Zero Trust Tunnel or a reverse proxy service like Caddy with a service like Cloudflare.

However, it's also my understanding that Cloudflare doesn't like large amounts of non-html data served on free plans. There are many different takes on what is permitted since changes were made to ToS wording, and I don't know If this applies just to Zero Trust Tunnels or all of Cloudflare services, including of used with a reverse proxy.

What is allowed, and what is the best and safest way to serve media from a home server with a .com?

The original post: /r/datahoarder by /u/level3comm on 2024-12-27 08:18:46.

Hi Everyone! I recently encountered a failing nvme drive in my main PC and saved 99% of it using the amazing GNU ddrescue tool. (https://www.gnu.org/software/ddrescue/) Sadly there were one or two files in my NTFS partition that were not saveable according to ddrutility, another amazing tool that with NTFS partitions can tell you exactly which files are bad. (https://sourceforge.net/p/ddrutility/wiki/Home/)

After getting worried by this experience, I also used the tool to recover two older external HDDs that had been sitting on a self and they also had bad sectors but running the tool overnight with a lot of retries, I was able to save 99% of sectors with no NTFS file system errors.

Anyway, my question is that I'm now stuck with these raw disk images that are the size of the entire drives, as shown in the photo. However the NTFS partition that spans the drives is only 40% full in the case of the 4TiB partition with the rest being for the most part almost all 0s.

So, I would imagine these files would compress really well with even gzip, but the more reading I have done the more lost I am on how I can ever safely delete these raw DD images.

It seems like the safest thing to do would be to copy these files to a ZFS partition and run regular scrubs to ensure they are not corrupt, but that would waste 60% of the storage space tracking the 60% of the empty NTFS partition on the drive.

The creator of lzip has a very long article(https://www.nongnu.org/lzip/safety//_of//_the//_lzip//_format.html) on why it is the best tool for error detection and recovery for large data stream compression, and I believe the recommendation of the lzip creator would be for me to TAR all the drive images I have in the photo together and then use lzip to compress the TAR.

However when researching additional LZMA compression technologies that competed with lzip I ran into the concept of the PAR file as an alternative to a TAR for stream compression to get even more redundancy and error detection/recovery.

Some folks pointed out though, that for this type of long term storage, its much better to use a file archive compression tool rather than a stream compression tool and I was recommended WIN-RAR which actually incorporates PAR files into the archives. I don't mind paying for that software if its the best tool for this job, but the settings page for the PAR portion is quite complex... I don't really know how much redundancy I want or need, it would be nice if I new the probability of a bit flip occurring and what it might do if undetected, but I don't know what that would be given this setup.

So I guess my question is, does anyone have experience archiving large sparse compressible DD images in a safe way, I'm leaning towards just copying them to my ZFS Zraid pool and taking the space hit to ensure ensure the ZFS checksums will keep the files safe, but if someone more knowledgeable about lzip/WIN-RAR can recommend settings that have worked well maybe I can delete the originals and store the archives instead.

https://preview.redd.it/cp5v854woc9e1.png?width=1638&format=png&auto=webp&s=4c0398d9e1153524ac5afcbfc0ba0ec709a5e08c

The original post: /r/datahoarder by /u/_thermix on 2024-12-27 08:09:15.

Switched to a laptop and still have my old desktop lying around with all my media in it (curently accessing the media in the external hdd I used for backup and now the PC is the backup), been thinking of turning it into a NAS (for seeding torrents and making backups) but I'm kinda concerned about the GPU drawing too much power and adding to my bill (I know it's just a few bucks per month but still, I don't wanna be wasteful).

Should I unplug the GPU? It won't be plugged into a monitor or running any GUI programs, but it just being there would still draw power, right?

Edit: It's a gtx 1650, and my CPU has a integrated gpu

The original post: /r/datahoarder by /u/mrskymr on 2024-12-27 07:41:22.

The original post: /r/datahoarder by /u/gastralia1 on 2024-12-27 07:19:32.

Hey all. I like to back up a lot of stuff and save lots of files.

Right now i have 2 external drives and 1 USB.

The USB is very slow when it comes to transferring data. I do plan to purchase a 2TB external drive soon. Which one would you recommend? In terms of transfer speeds and cost. Should I just get 2 separate 1TB drives? I'm kind of new to the whole backing up a bunch of files and just data hoarding. so any tips and program that might be helpful would be nice to know. Thank you!

The original post: /r/datahoarder by /u/ExcuseNumerous on 2024-12-27 07:11:47.

So basically I used windows and am always low on space and performance issue, I want to shift to linux but don't have space for dual boot, also my windows have lot of my work.

So I am planning to slowly shoft to linux, and thought to run it on an external SSD(which is out of my budget at this moment) , then I thought to buy a sata SSD with an encloure and run VM on it to launch linux, will it work??

The original post: /r/datahoarder by /u/Temporary_Potato_254 on 2024-12-27 06:58:15.

The original post: /r/datahoarder by /u/Rezasaurus on 2024-12-27 06:48:45.

The original post: /r/datahoarder by /u/Proteus356 on 2024-12-27 05:43:40.

Got a storage server (Truenas) based on a P620 with 6HDD and looking for some more expansion, ideally 8-12 drives. Would prefer SAS if at all possible. I am looking for something storage specific. Quiet and compact that doesn’t look like crap (has to pass WAF as it will be in living room). So far, it looks like some of the NAS vendors make nice gear, but I don’t need or want the NAS part. I just want the case itself. I just need a dumb enclosure with SFF-8087 SAS ports to plug into an LSI SAS card. Something like the Areca 8-12 drive desktop enclosures (but JUST the enclosure without their controller) or the Terramaster T9-12, or the Synology or Qnap 8-12 drive enclosures would be great. Unfortunately everything I’ve found so far is just USB or thunderbolt (useless for Truenas). Oh..and I do NOT need hotswap. If there is something small and elegant, like an SFF PC with a way to fit 8 internal 3.5” drives and a pair of SFF8087 SAS expansion ports, that would be perfect.

So far, the closest I’ve found is a U-NAS ES-810 expansion (on their website, but doesn’t seem to be available anywhere) or the old QNAP TL-D800S (looks nice, but SATA, not SAS, and ridiculously overpriced.

Help!!

The original post: /r/datahoarder by /u/Familiar_Leather on 2024-12-27 04:39:20.

I pay $10.00 a month for Google One so I can use their 2 TB of cloud storage in order to back up important files from my computer. I want to be able to regularly back stuff up, but Google makes it such a pain in the ass to do! Files take hours, if not DAYS to upload sometimes, and I've tried everything I can think of. I've used Firefox. I've used the Google Drive desktop app. I've used Chrome. I've used Edge. My internet is very fast, so I don't understand what the problem is. Is Google throttling the upload speeds for a service I'm paying for? How can I fix this? I like the security that Google offers so I wouldn't switch unless I found a similarly priced and similarly secure, well known and trusted service to switch to.

My internet speeds, according to Speedtest . net are...

Download: 131.88 MBPS

Upload: 169.78 MBPS

(Mind you, I ran this test with Steam, Telegram, and Discord open, as well as streaming a movie and having about 12 tabs open for various websites on Firefox all on the same device, so it's probably actually higher than that if I don't have anything running.)

The original post: /r/datahoarder by /u/AngryMobster on 2024-12-27 04:09:33.

As per title, I have easy access to Seagate products in my region. but i'm majorly confused by the products such as Ironwolf/Firecuda/EXOS/etc. Which one should I go for i'm just looking to store and maybe watch videos on? A high read/write is also preferable.

I almost pulled the trigger on the EXOS but then there were multiple versions of them too like 7E10, 7E8, X16 and such.

The original post: /r/datahoarder by /u/rukawaxz on 2024-12-27 04:08:08.

The original post: /r/datahoarder by /u/SarthakSidhant on 2024-12-27 03:42:03.

edit: ignore this post please - i think i made a mistake or the seller made the msitake

my motherboard - x99 FD4 which is a dual CPU motherboard requires a 2x 30 PIN PSU, i tried finding it online but couldnt get any of them - could you suggest what wattage should i go for considering 8 2TB each - hard disks are connected? it runs a dual E5 2686V4

The original post: /r/datahoarder by /u/ContextMaterial7036 on 2024-12-27 03:15:49.

Title. What if I upgrade my 4TB drive to higher capacity one and copy current files over to it from the current one mapped to iDrive.

Will iDrive want to re-upload all of the files again since the modified timestamp or device changed?

If so, any way to avoid having to do that?

The original post: /r/datahoarder by /u/ThatFeel_IKnowIt on 2024-12-27 02:44:02.

I am massively confused by reading people's experiences with Windows Mirrored Volumes. There are 2 things that are confusing me. I will list them below. But first, I will also list my setup:

My setup: I have 2 internal HDDs in my PC with files on them. The disks are set up as dynamic disks with mirrored volumes. I was under the assumption that if one disk fails, the data will still be on the other. DISCLAIMER: I also have offsite backups. This is NOT my primary backup method. It's just a data protection method. Also, my OS is NOT on these HDDs. It's on a NVME SSD.

Confusion Point #1: I see people saying that if one disk drive dies, then you CANNOT access your data on the other mirrored drive? You have to have BOTH disks active? That makes no sense and defeats the purpose of mirrored volumes, and even goes against what Windows says on their website?

Confusion Point #2: People claim that if you were to reinstall windows or move the two mirrored disks to another PC, it cannot be accessed since you need to have the original disks on the original OS install to access them, plugged into the original SATA ports you used when making the mirrored volumes? This also makes no sense and I am like 99% sure I have indeed reformatted before and had no issues accessing the disks after?

Can anyone help explain these two confusion points to me?

Also, I realize that disk management mirrored volumes are technically "deprecated" however they still seemt to work? Storage spaces is newer but I've heard horror stories with that too..