It's A Digital Disease!

The original post: /r/datahoarder by /u/ProbablyCassy on 2024-12-24 02:47:28.

Idk if this is allowed if not then please delete. BUT I'm trying to download a website (MAPS) using HTTTrack but it keeps coming out as indexbc6f.html when I try to view the mirrored site. I've tried changing the preferences and settings but it isn't changing the outcome. Anything Helps!

The original post: /r/datahoarder by /u/jetjebrooks on 2024-12-24 02:21:17.

i have a 6tb wd, usb-c powered, external harddrive that i want to connect to my media player. this media player has a 1tb internal harddrive and some usb ports - it is these usb ports that i want to connect my 6tb wd hdd too.

the problem is when i connect my 6tb hdd to these ports they evidently do not provide enough power for the 6tb hdd to function. it doesn't show up at all and can't be read. i know the ports work because i can connect my small 16gb-ish thumb drives to it and they show up fine

so is there any way to provide power via external means to my usb-c powered hdd, so that it will work on a device that cannot power it by usb alone? thanks.

The original post: /r/datahoarder by /u/ibby200912 on 2024-12-24 01:04:19.

The original post: /r/datahoarder by /u/keybhoarder on 2024-12-23 10:21:21.

I have the infrastructure for this but I don't have most of the business side in place so this does not constitute any formal offer yet. Just trying to gauge if there is some interest in a service that provides LTO backup services where you store the tapes yourself long term. This saves you the cost of a tape drive while still having the benefits of long term tape storage.

How it would work:

• You encrypt and tar/compress your data on your side to 100 MB+ chunks.
• You upload your encrypted tars/zips/whatever to one of our servers, or alternatively ship us a drive which we'll ship back to you with the tape(s).
• We copy the data to LTO8 tape for you.
• We checksum the tapes on a second drive and email you the MD5's for checking
• After verification, we delete the local copy of your data and ship the tape(s) to you for long term storage.
• To restore, send us back a tape and an empty drive or a link to a server online where we can copy the data to (provided that server has 1GBit or better connectivity, preferably 10Gbit).
• The tapes will be in standard LTFS format. You can rent any compatible LTO8 drive to restore it, you don't need to go through us.
• We're located in the US (WA state)

The cost structure would have to be something like below to cover labor as well as the amortized cost of the hardware:

• $6 per TB written
• $4 per TB read or verified
• If we supply the tapes, add the published cost of the LTO8 tapes with barcode from TapeAndMedia. Or we can overwrite/append to an existing tape that you sent to us first.
• LTO8 tapes can store up to 12TB / 10.9 TiB of real data. Ignore the compression ratings. If you have data that compresses well, do it on your side before uploading - it will be cheaper for you.
• $20 setup cost if total read/write/verify cost for a job is under $100
• Add sales tax and shipping

So e.g.

• 2 TB: $12 write + $8 verify + cost of a tape ($58) + $20 setup = $98.
• 10 TB: $60 write + $40 verify + cost of tape ($58) = $158.
• Restore 10 TB: $40 read + $20 setup = $60
• You can skip verification if you want. I would not recommend it since there is a network copy involved as well.

Would anybody be interested in this kind of service at these prices?

The original post: /r/datahoarder by /u/TeachDapper9910 on 2024-12-23 07:28:38.

HI, im am trying to save these old blueprint images from jstor . https://www.jstor.org/stable/community.35216270

I tried dezoomify and it cant find any images on the page Would anyone have any ides on how to save these files?

thanks very much

The original post: /r/datahoarder by /u/iRl8x on 2024-12-23 21:22:07.

Hello everyone!

I recently got the new Mac mini and I’m looking for a USB hub or dock that offers plenty of USB-A and USB-C ports for my devices. I need it for things like a microphone, amplifier, BEACN Mix Create, external speaker, and a mouse (with a USB dongle). I’d also like to have one or two extra ports for future needs.

When I searched, most hubs/docks I found max out at 4 USB ports (2x USB-A and 2x USB-C). I don’t need other ports like HDMI or Ethernet. I was considering the Acasis 21-in-1 since it has enough USB ports, but paying for a Thunderbolt 4 product feels like overkill just for these devices. Also, I have seen a lot of comments saying that it keeps disconnecting because of heat.

Does anyone have recommendations for a simpler, more affordable hub that fits my needs? Thanks in advance!

The original post: /r/datahoarder by /u/ImminentFallout on 2024-12-23 20:40:51.

I built my first PC back in late 2019 and I've recently been upgrading it slowly so i decided to check my drive health and realized my 2TB HDD that i use solely as a bulk storage device for pictures, documents, steam games i don't play etc. has a Caution sign but i honestly don't know how to interpret this data.

I've never dealt with dying drives as this is my first build but i backed up my data just in case and was wondering if this is a sign that i should replace this drive or not.

https://preview.redd.it/my1ynvbltn8e1.png?width=665&format=png&auto=webp&s=ffae92448cc2ef10faa74752e11b4d150b7bf907

The original post: /r/datahoarder by /u/issue9mm on 2024-12-23 20:12:02.

I've lucked into some hardware that was semi-affordable over time, but after some of them are now in disarray.

What I currently have running is a qnap 12-bay NAS running QTS and a super janky (but still extremely reliable) system I built into a new-two-decades ago Lian-Li PCA-77 aluminum case that still rocks, but is very dated. In that case, I've got 2 IcyDock FatCages that convert 3 5.25" bays into 5 3.5" hot-swappable bays, running on an Athlon FX-8350. Both of these are at ~50-60% capacity. I also have ~80 WD Red 8Tb drives, most of which were known-good when pulled (but are old.)

What currently is NOT running is a 45-Drives 45-bay chassis -- it's one of the old ones with the crappy HighPoint adapters and has at least a broken power supply that I can't find a direct replacement for. I also have a Supermicro Superstorage 6047R-E1R72L 72-bay server that has never POSTed. I bought it earlier this year from The Server Store and while they were willing to help support it, I had a car accident and a medium-sized family emergency that pushed me out of the 90 days support for it before I could get it done, so now I just own this brick and I'd like to put it to use. I specced the Supermicro with 3x 10G Intel SFP cards so that I could have them in other devices. IIRC, the Storinator came with 10G onboard but I can't remember the form factor (and it hasn't worked in forever.)

So, I'd like either of these to work and do something. Happy to replace motherboards (and maybe go with something a little bit lower power consumption) -- noise isn't too big an issue as I've got a storage room in the basement that they run in, but if there was an opportunity to replace with a less-redundant / quieter power supply, I'd probably jump on it. Willing to buy new parts, but I haven't built anything like this from scratch, so figured I'd ask you wizards. The ideal system I end up with should be able to run TrueNAS, which is just something I would really like to play with.

The original post: /r/datahoarder by /u/embracebecoming on 2024-12-23 20:09:47.

Does anyone have a .zim version of Wikipedia from early to late 2022? I'd like to have one from before the release of ChatGPT, but kiwix doesn't seem to make old versions available for download.

The original post: /r/datahoarder by /u/sabotage3d on 2024-12-23 19:43:47.

I am a bit confused with all the options for N100 motherboards. I am looking at this one, but it is quite cheap are there any drawbacks to it? https://cwwk.net/products/12th-i3-n305-n100-nas-motherboard-6-bay-dc-power-2xm-2-nvme-6xsata3-0-pcie-x1-4x-i226-v-2-5g-lan-ddr5-itx-mainboard?variant=45383984808168

I want to pair with SFX power supply and Jonsbo N2/3 or Fractal Node 304.

The original post: /r/datahoarder by /u/noremoretokes on 2024-12-23 19:02:56.

I'm looking to get a 4TB SSD, either NVMe and I'll get an enclosure, or an external one to hook up to my MacBook, main use is to have my Photos library in it (1.2TB and growing) and other project, raw image files, etc.

I was looking at the Crucial P3 Plus because it's fairly good value, but I'm open to any other suggestions, also considering Samsung, like the 990 Pro (even though it's a bit of a stretch), other externals like the Samsung T7 and T9 are a bit over budget where I live.

Speed isn't a priority as much as reliability but is welcome, I was even thinking of the Samsung T5 Evo since it's really cheap but I'm not sure if it would be a good idea.

Basically these are the prices I have available (all 4TB drives):

• Crucial P3 Plus - 230€ (I already own an enclosure)
• Samsung T5 EVO - 240€
• Samsung 990 EVO Plus - 280€
• Samsung 990 Pro - 290€
• Samsung T7 - 320€
• Samsung T9 - 350€

I'm also open to other brands as long as they are good, I guess my budget is happier about 200$/€ to 300$/€ and everything above 300 is a bit too much.

The original post: /r/datahoarder by /u/HedgeFundManager1997 on 2024-12-23 18:43:09.

So I use Crystal mostly to check operating hours as study of usage before I trash it for larger capacity

Sentunal wants cash so I do not like it much and it is not that good

Seatools works and WD tool is vendor locked

The original post: /r/datahoarder by /u/Large-Style-8355 on 2024-12-23 18:21:01.

Having a my own Ubuntu home server since 15+ years (mail smart host, samba, Logitechmediaserver, Picapport Media server and more) I'm currently in the process of moving and modernizing services on a Proxmox VE. All my former iterations had extern USB 3.5 and later 2.5" (less noise) USB hard disks as data grabs. The new proxmox host with multiple Linux Containers (no VM) is running in a laptop with an internal 1 TB SSD for alle the day to day stuff and has an external USB3 6 TB 2.5" HDD with btrfs attached. The majority of our data is 3.5 TB photos and videos from our smartphones plus about 100 GB of Maildirs on the SSD.

I got a large collection of older and newer HDDs of various sizes like 160GB, 300GB, 2x 500GB, 2x 1TB, 4TB an 5TB. I'm looking for good ways to make use of those HDDs - but they shouldnt run all the time (energy, noise) and only improve my system e.g. adding space for temporary media downloads (couple of weeks) or increasing data safety like in adding Raid modes etc.

What would you guys do with those drives?

Or would it be just better to get a cheap 18 TB USB drive and go with that - I'm just a little bit afraid it could be too loud sitting in a shelf in the living room...

The original post: /r/datahoarder by /u/mdragnev on 2024-12-23 18:17:07.

I can sort of understand what happens inside a drive when a sector that needs to be remapped is found during writing. However, if the number of reallocated sectors is rapidly growing during reading, can the data be trusted? I feel like the answer is a 'maybe' at best, but I wanted to hear your opinions and experiences.

The original post: /r/datahoarder by /u/xluxeq on 2024-12-23 17:45:28.

I decided to build my backups and storage spaces mirror on ReFS

I haven't had any issues so far, except the scheduled task "Data integrity check and scan" didn't seem to scrub the drive on the scheduled date, just ran a "integrity check"

Only have my one Windows PC so that's partly why I wanted to use ReFS plus for the auto repair and checksum/integrity streams.

I read this article which is reassuring (someone at the bottom stated the repair functionality is working correctly) Except #3 seems still valid.

https://stackoverflow.com/questions/52038295/how-to-programmatically-simulate-file-corruption-to-test-refs-health-check-and-r

ALTHOUGH when I manually ran the "Data Integrity Check and Scan" task it scrubbed the disk initially, but not afterwards on schedule. So I'm thinking of enabling both scheduled tasks to run once every 8 weeks.

Like this:

Integrity Check and Scan - 1st

Jan, Mar, May, July, Sep, Nov

Data Integrity Scan - 1st

Feb, Apr, June, Aug, Oct, Dec

The original post: /r/datahoarder by /u/RevolutionaryFee4173 on 2024-12-23 17:23:07.

i lowkey don’t know if this would go here so lmk if it doesn’t 🙏

because of tiktok’s possible banning, i want to download all my videos since i’ve had my account since 2021 and i have a bunch of shit i want to hold onto

i saw a post from like 2020/2019 asking the same question but i’m not going to waste my time doing what people told them to do just in case they’re outdated methods or something

The original post: /r/datahoarder by /u/TechnoSerf_Digital on 2024-12-23 17:13:50.

I'm a degenerate information hoarder and I need an intervention. You see, I have a habit of screenshotting, bookmarking, and saving posts and info I find online that is useful to me. Whether it's relationship advice, recipes, or tips for data storage.

My problem is it's like I never saved it at all because I never reference it again! It just piles and piles. How do I organize it and build a habit that actually makes it useful? Thanks

The original post: /r/datahoarder by /u/superelectric on 2024-12-23 15:31:32.

https://preview.redd.it/1kalkzam7m8e1.jpg?width=4032&format=pjpg&auto=webp&s=e1b0974a569db1141dfa7b8f746dd37b440f589d

I have around 5TB photos, plus a lot of other files. Files from the new camera are ~50MB each, so it grows quickly, especially when doing time-lapses, or video. After years of juggling lots of external hard drives, distributing backups to family, etc. I now have a set-up I'm happy with:

• Main NAS: Synology DS923+ with four 8TB drives (21TB total)
• Off-site (soon) NAS: Synology DS418 with two 8TB and two 4TB drives (14TB total)

My MacBook has 2TB built-in storage and I've velcroed a small Crucial X10 4TB SSD to the back of the display, so I have local backup of new files while on the go. I send new photos to the DS923+ with "rsync -e ssh" (with Tailscale - it's awesome!), and also mirror it with rsync to the DS418.

So now I have "unlimited" storage (with SHR and 1-drive fault tolerance, easily upgradeable), off-site backup, and access to everything from anywhere.

The original post: /r/datahoarder by /u/Dangerous_Mammal on 2024-12-23 14:55:46.

https://preview.redd.it/tjh2jlo12m8e1.png?width=677&format=png&auto=webp&s=a175bb63ff1578826ec355cdac3aa36cae0ae99e

I'm using a UGreen enclosure, Kingston nv3 chip(1tb). I have checked the enclosure, chip, cable, usb 3 port for damage and compatibility, and there are no obvious issues. It's using USB 3.2, Pcle 4.0. The computer( windows) can recognise the drive, which is in ntfs format, and read/write files off the drive but is slow . I ran crystaldiskmark 8, and the result is above. It sucks.I'm so frustrated. How can I fix this issue and improve the read/write speeds?

The original post: /r/datahoarder by /u/QueenAng429 on 2024-12-23 14:17:38.

Scanning all my paper documents to have digital instead of paper, I have a pretty high end printer/scanner which does I think 1200 dpi scanning. This ends up with almost 4mb per page scanned. I know you don't need 1200dpi, but 1200 dpi let's you zoom in and see the fibers of the paper, I prefer to have the highest resolution if I'm going to destroy the paper copy so that I can print an equivalent original looking copy later if needed. Am I just going to be stuck with having PDFs over 100mb if it's 20 pages, or is there a way to losslessly compress that the scanner isn't going to do on its own?

The original post: /r/datahoarder by /u/actuallychris2 on 2024-12-23 11:55:28.

I recently inherited a backblaze 3.0 pod that needs a bit of work to get going. If possible, I'd love to use it for storage in my network as I'm starting to get up in the DataHoarder range (75TB-100TB. At this point, I have looked at trying to set that up with ZFS. As the server currently uses 5 drive backplanes, speed would slow down using their style as found in their standard builds (I'm pretty sure this is a 3.0 pod images)

My questions really revolve around if I should keep the backplanes or should I overhaul the build to use direct drives with the same chassis. Or should I abandon the hardware altogether and look for an alternative?

Linux knowledge isn't something I'm worried about. My OS I'm probably going to go with will most likely be truenas simply because of my experience with it, however I am open to other options.

The original post: /r/datahoarder by /u/kurkr99 on 2024-12-23 12:12:34.

hello, does anyone has recommendation for SSD that has long life span at least 4-5 years of use (and probably able to withstand occasional force shutdown) ?

I have samsung ssd 870 that broke down immediately after only 2-2,5 years for light daily use (Recently, an app cause my PC to freeze and i had to force shutdown, never had any freeze or sudden shutdown before) Turns out samsung produce a batch of faulty SSD on that type. I also see some couple bad review of samsung nvme 990 pro

I'm also using 980 NVME samsung when that shutdown happen. Fortunately, it's still alive but i would prefer not to take any risk.

Does anyone has recommendations for SSD besides samsung?

Is there any SSD that has power loss protection? or is it exclusively for enterprise server grade SSD ?

*also might want to avoid mx500 for now 🙏because of this post https://www.reddit.com/r/buildapc/comments/130v2jw/crucial_mx500_and_samsung_870_evo_recents/ 

or does anyone has experience with good 3-4TB HDD that has been used at least 5 years?

The original post: /r/datahoarder by /u/iGunzerkeR on 2024-12-23 12:00:43.

I currently use underscores and lowercase to name folders and files. However, I'm not sure what to do with acronyms, such as ac1_random_name vs AC1_random_name. How do you approach this?

The original post: /r/datahoarder by /u/Nexusyak on 2024-12-23 10:18:42.

I'm looking to expand the number of drives in my regular PC (not a NAS build) as I've run out of motherboard SATA ports. I'm trying to decide between a regular PCIe SATA expansion card and an HBA card. I have never done this before and not 100% sure on how to do it.

Current Setup:

-Gigabyte Aorus Elite Z390 -8 drives SATA, SSD, NMVE drives currently connected -4x 20TB SATA drives I want to add already. (I will have space for 3-5 more additional drives after those) -Using a Fractal Define R6 Case with additional trays.

Questions:

1. For a regular PC user, what are the real-world advantages/disadvantages of using an HBA card vs a PCIe SATA expansion card?
2. If HBA is the way to go, would something like the LSI 9211-8i be a good choice for a regular desktop user?
3. Are there any compatibility issues I should be aware of?
4. What's the typical power consumption difference between these options?
5. Additional parts you think I will need besides the expansion card?

Budget: No budget restrictions.

Additional Information:

• I'll be using this for a regular desktop PC, not for a NAS or server
• Primary concern is reliability and ease of use
• Looking to understand the real-world performance differences
• Not looking to do a raid setup. Not crucial data.

Any advice would be greatly appreciated!

Thanks in advance,

The original post: /r/datahoarder by /u/amanlyunicorn on 2024-12-23 08:22:58.