It's A Digital Disease!

11 readers
1 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
626
 
 
The original post: /r/datahoarder by /u/Scryotechnic on 2024-12-19 08:03:47.

Hi All,

I'm new to this stuff, but trying to learn. I've got a NAS rated Seagate drive in a DAS enclosure attached via USB C to a laptop running Plex in a VM on a hypervisor.

I was doing my usual downloading. No more than 8 torrent active downloading, maybe 6 uploading. Someone in the house was watching a video from it. And then I had the genius idea to, from my personal PC, plug in my phone so I could load a file from the DAS to my phone directly. When I did this, the GUI element that windows pops up for file copy progress was stuck at 0%. I closed it and tried again. Now this is me being dumb, I tried it two more times. Then I got IO fails on the torrent and realized the drive just errored out IO -5 fail. Error at 0x2. I then rebooted, dumbly restarted my torrents, and immediately failed again. This time I rebooted, ran xfs repair, cleared and deleted the partially downloaded torrents. Now things seem back to normal, but I haven't had time to run a full health check on the drive since it's an 8tb drive.

I'm wondering what specifically caused it so I can avoid the fail in the future. I just tried transferring the file that I was trying to get on my phone to my personal computer first, then to my phone, and that worked without issue. I'm wondering if trying to transfer from the server DAS drive over my network to my phone connected to my PC was the issue. It's the only thing I did differently than I would usually do. I'm wondering if there are permissions on the newer Android phone that would have refused the file transfer due to it not coming directly from the PC I had it plugged into. I'm also unsure if this little mishap caused permanent damage to my drive.

I'm a noob, but still a nerd, so hopefully I'll understand. Any thoughts are appreciated!

627
 
 
The original post: /r/datahoarder by /u/Packabowl09 on 2024-12-19 06:48:28.
628
 
 
The original post: /r/datahoarder by /u/GamingDragon27 on 2024-12-19 06:40:15.

Original Title: Friend sent me this pic of SIGNIFICANTLY clearanced DVDs and CDs at a store. I had never considered using DVDs (or CDs) for storage, anything in particular that might be worth picking these up for? What sort of data would be good to hold in ~5 GB chunks? ($16 a TB)

629
 
 
The original post: /r/datahoarder by /u/_gadgetFreak on 2024-12-19 05:36:05.
630
 
 
The original post: /r/datahoarder by /u/-ThatGingerKid- on 2024-12-19 05:18:45.

If you're setting up a NAS home server to operate as backup storage / a media server, etc. Why do some prefer Proxmox on bare metal as opposed to one of the many NAS OSes that support virtualization? I guess in my mind it seems redundant to have an OS designed for virtualization on bare metal with a NAS OS (that probably supports virtualization) virtualized. But I'm very much a noob and really just trying to learn. I don't know what I don't know and am trying to fill my knowledge gaps.

631
 
 
The original post: /r/datahoarder by /u/DontKnowHowToEnglish on 2024-12-19 04:33:12.

Pretty much the tittle, trying to settle a dispute with a store and would appreciate to know how the drives from serverpartdeals arrived this last month or so, ideally single drives

Appreciate your time!

632
 
 
The original post: /r/datahoarder by /u/denierCZ on 2024-12-19 02:24:49.

question in title - Can Playstation 5 play/view content of M-disc Blu ray?

633
 
 
The original post: /r/datahoarder by /u/mdknight666 on 2024-12-19 01:43:51.

I have 2 14 tb drives on windows 10. One drive had an error after booting and disk repair fixed a lot of things but I believe something was corrupted along the way.

My other drive has no errors and was regularly cloned from the source drive. I did this before the corruption occurred.

I want to compare these 2 drives now to see which files mismatch in file size or any other metadata, so I can correct it.

Are there any recommended apps for windows that can do this?

634
 
 
The original post: /r/datahoarder by /u/Micsnotworking on 2024-12-19 01:06:46.

I am looking to upgrade my storage on my laptop workstation, what is the most reliable model with a relatively decent price? More specifically Nvme m.2 2280 gen 3

635
 
 
The original post: /r/datahoarder by /u/JaiHaze on 2024-12-19 00:41:01.

I am running all SSD's, about 32tb with the 1618+. When I access the files with SMB I find it to be slow sometimes. Its connected thru the 10gb expansion slot, but sometimes I feel like its not fast enough. If I upgrade to the 1821/23, I see the CPU is much better but will I notice a difference on speed of loading the SMB?

636
 
 
The original post: /r/datahoarder by /u/nerdguy1138 on 2024-12-19 00:20:37.

473c86d147b392d9e781ed5fc7d2e17fb229981e hash of the torrent.

600+gb 1080p upscaled. not by me.

it's already on a bunch of trackers, here's the magnet link

magnet:?xt=urn:btih:473c86d147b392d9e781ed5fc7d2e17fb229981e&dn=473c86d147b392d9e781ed5fc7d2e17fb229981e&tr=http%3A%2F%2F125.227.35.196%3A6969%2Fannounce&tr=http%3A%2F%2F210.244.71.25%3A6969%2Fannounce&tr=http%3A%2F%2F210.244.71.26%3A6969%2Fannounce&tr=http%3A%2F%2F213.159.215.198%3A6970%2Fannounce&tr=http%3A%2F%2F37.19.5.139%3A6969%2Fannounce&tr=http%3A%2F%2F37.19.5.155%3A6881%2Fannounce&tr=http%3A%2F%2F46.4.109.148%3A6969%2Fannounce&tr=http%3A%2F%2F87.248.186.252%3A8080%2Fannounce&tr=http%3A%2F%2Fasmlocator.ru%3A34000%2F1hfZS1k4jh%2Fannounce&tr=http%3A%2F%2Fbt.evrl.to%2Fannounce&tr=http%3A%2F%2Fbt.rutracker.org%2Fann&tr=https%3A%2F%2Fwww.artikelplanet.nl&tr=http%3A%2F%2Fmgtracker.org%3A6969%2Fannounce&tr=http%3A%2F%2Fpubt.net%3A2710%2Fannounce&tr=http%3A%2F%2Ftracker.baravik.org%3A6970%2Fannounce&tr=http%3A%2F%2Ftracker.dler.org%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.filetracker.pl%3A8089%2Fannounce&tr=http%3A%2F%2Ftracker.grepler.com%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.mg64.net%3A6881%2Fannounce&tr=http%3A%2F%2Ftracker.tiny-vps.com%3A6969%2Fannounce&tr=http%3A%2F%2Ftracker.torrentyorg.pl%2Fannounce&tr=https%3A%2F%2Finternet.sitelio.me%2F&tr=https%3A%2F%2Fcomputer1.sitelio.me%2F&tr=udp%3A%2F%2F168.235.67.63%3A6969&tr=udp%3A%2F%2F182.176.139.129%3A6969&tr=udp%3A%2F%2F37.19.5.155%3A2710&tr=udp%3A%2F%2F46.148.18.250%3A2710&tr=udp%3A%2F%2F46.4.109.148%3A6969&tr=udp%3A%2F%2Fcomputerbedrijven.bestelinks.nl%2F&tr=udp%3A%2F%2Fcomputerbedrijven.startsuper.nl%2F&tr=udp%3A%2F%2Fcomputershop.goedbegin.nl%2F&tr=udp%3A%2F%2Fc3t.org&tr=udp%3A%2F%2Fallerhandelenlaag.nl&tr=udp%3A%2F%2Ftracker.openbittorrent.com%3A80&tr=udp%3A%2F%2Ftracker.opentrackr.org%3A1337&tr=udp%3A%2F%2Ftracker.publicbt.com%3A80&tr=udp%3A%2F%2Ftracker.tiny-vps.com%3A6969

UPDATE: sesame street magnet link here

magnet:?xt=urn:btih:320166aa5e7df2a6a77eb83749d91da12c7cfd0b&dn=sesame-street&tr=udp%3A%2F%2Fpublic.popcorn-tracker.org%3A6969%2Fannounce&tr=http%3A%2F%2F104.28.1.30%3A8080%2Fannounce&tr=http%3A%2F%2F104.28.16.69%2Fannounce&tr=http%3A%2F%2F107.150.14.110%3A6969%2Fannounce&tr=http%3A%2F%2F109.121.134.121%3A1337%2Fannounce&tr=http%3A%2F%2F114.55.113.60%3A6969%2Fannounce&tr=http%3A%2F%2F125.227.35.196%3A6969%2Fannounce&tr=http%3A%2F%2F128.199.70.66%3A5944%2Fannounce&tr=http%3A%2F%2F157.7.202.64%3A8080%2Fannounce&tr=http%3A%2F%2F158.69.146.212%3A7777%2Fannounce&tr=http%3A%2F%2F173.254.204.71%3A1096%2Fannounce&tr=http%3A%2F%2F178.175.143.27%2Fannounce&tr=http%3A%2F%2F178.33.73.26%3A2710%2Fannounce&tr=http%3A%2F%2F182.176.139.129%3A6969%2Fannounce&tr=http%3A%2F%2F185.5.97.139%3A8089%2Fannounce&tr=http%3A%2F%2F188.165.253.109%3A1337%2Fannounce&tr=http%3A%2F%2F194.106.216.222%2Fannounce&tr=http%3A%2F%2F195.123.209.37%3A1337%2Fannounce&tr=http%3A%2F%2F210.244.71.25%3A6969%2Fannounce&tr=http%3A%2F%2F210.244.71.26%3A6969%2Fannounce&tr=http%3A%2F%2F213.159.215.198%3A6970%2Fannounce&tr=http%3A%2F%2F213.163.67.56%3A1337%2Fannounce&tr=http%3A%2F%2F37.19.5.139%3A6969%2Fannounce&tr=http%3A%2F%2F37.19.5.155%3A6881%2Fannounce&tr=http%3A%2F%2F46.4.109.148%3A6969%2Fannounce&tr=http%3A%2F%2F5.79.249.77%3A6969%2Fannounce&tr=http%3A%2F%2F5.79.83.193%3A2710%2Fannounce&tr=http%3A%2F%2F51.254.244.161%3A6969%2Fannounce&tr=http%3A%2F%2F59.36.96.77%3A6969%2Fannounce&tr=http%3A%2F%2F74.82.52.209%3A6969%2Fannounce&tr=http%3A%2F%2F80.246.243.18%3A6969%2Fannounce&tr=http%3A%2F%2F81.200.2.231%2Fannounce&tr=http%3A%2F%2F85.17.19.180%2Fannounce&tr=http%3A%2F%2F87.248.186.252%3A8080%2Fannounce&tr=http%3A%2F%2F87.253.152.137%2Fannounce&tr=http%3A%2F%2F91.216.110.47%2Fannounce&tr=http%3A%2F%2F91.217.91.21%3A3218%2Fannounce&tr=http%3A%2F%2F91.218.230.81%3A6969%2Fannounce&tr=http%3A%2F%2F93.92.64.5%2Fannounce&tr=http%3A%2F%2Fatrack.pow7.com%2Fannounce&tr=http%3A%2F%2Fbt.henbt.com%3A2710%2Fannounce&tr=http%3A%2F%2Fbt.pusacg.org%3A8080%2Fannounce&tr=http%3A%2F%2Fbt2.careland.com.cn%3A6969%2Fannounce&tr=http%3A%2F%2Fexplodie.org%3A6969%2Fannounce&tr=http%3A%2F%2Fmgtracker.org%3A2710%2Fannounce

637
 
 
The original post: /r/datahoarder by /u/datawh0rder on 2024-12-19 00:17:19.

After much tinkering I think I've found my optimal backup strategy. I'd like to gather some feedback as well as post for posterity for other data hoarders looking at options!

My data setup is currently 3 24TB drives in RAIDZ1 on TrueNAS. I have a 4th on ice for expansion/replacement. I have several "top-level" datasets— Immich, Media, TimeMachine. The Media dataset has a sub-dataset for each type of media (movies, tv, games, etc.). Each dataset carries two designations— hot vs cold, and update vs. append-only. These designations help with snapshot and backup strategy.

"Hot" data is data I may need to read from quickly in case it becomes unavailable or corrupted for some reason. This includes my Immich dataset and my TimeMachine dataset. TM is limited to 4TB and rsync sync's weekly to Backblaze. Immich is unlimited and rsync copies daily to backblaze.

"Cold" data is data that will not change and that I never need immediate access to. This is basically everything under my Media dataset. All sub-datasets rsync copy to Glacier Deep Archive daily.

Next, I do snapshots. For "append-only" datasets (Immich, Media) I do snapshots once daily since they won't take up much space when you are almost exclusively adding files. Snapshots live for two weeks. For data that may be updated significantly each time I write (TimeMachine) I don't do snapshots to save space (I'm okay with the lessened data security here since this is a backup of my laptop and also has another copy in backblaze).

Overall at the moment this brings my costs to about $12-13/month right now (~1.3 TB in Backblaze, ~3.5 TB in Glacier). As this scales this should keep costs low as TM has a limited quota and immich will grow very slowly over time as it's only for me and one friend and i don't take tons of pics. And GDA is $1/TB/mo so as my media grows I'll be able to store safely without too much on the wallet.

Yes, I know GDA has high egress costs. However, I would only need this in the very unlikely case that a drive fails and another drive fails while resilvering (which, btw, is NOT actually significantly more likely to happen than under normal conditions as this sub would have you think).

What are your thoughts? Could I further optimize costs anywhere? Are there risks here that I'm blind to that I'm not covering?

638
 
 
The original post: /r/datahoarder by /u/Dagobert_Krikelin on 2024-12-18 23:56:56.

Hi. I have a DVD I want to rip and place in my library. In the DVD there's a behind the scenes(bts) clip too,

I first tried this using MakeMKV and fed it the VIDEO_TS.IFO. It would open up and show me the movie and the behind the scenes clip. The info in there are:

Resolution: 720x576

Aspect Ratio: 16:9

Frame Rate: 25

I tried making mkv:s out of them and it seems perfect. I suppose this is what people call a remux?

Nothing has been altered, just moved to another container.

So the movie is fine, but the problem is with the bts. It doesn't look correct at all. Am I understanding things correctly that the resolution is one thing and how it is displayed is another thing. It's in fact being stretched out to a 16:9 aspect ratio. So the pixels are non-square? And this is a common procedure I'm sure. If they would be square the resolution would have had to be 1024x576 for 16:9.

If I play the movie in VLC it will show me a correct picture, defaulting to 16:9 and if I snapshot a frame and inspect it, it will indeed be 1024x576.

Now the issue is with the bts. This will do exactly the same as it has the same media info as the movie. However the bts is not a 16:9 recording. I believe it should be 4:3, or possibly 5:4, but a 5:4 looks too squished. 720x576 with square pixels is a 5:4 aspect ratio though, but I think it looks better at 768x576. How can I even tell what the correct aspect ratio is?

I assume someone didn't care too much when making this clip for the DVD.

I would like to rectify this. but not sure exactly how to. Is there a way to add some metadata to say this is a 4:3 aspect ratio or how does it work?

as it looks when taking a snapshot with VLC.

639
 
 
The original post: /r/datahoarder by /u/paradox_pete on 2024-12-18 22:34:17.

Trying to find a cheap desktop drive for mass storage. something under 300 USD (I live in New Zealand). Came across these two drives from this vendor (prices seem reasonable) but not sure what the difference is

https://east-digital.myshopify.com/products/seagate-st16000nm001g-16tb-exos-x16-512e-6gb-3-5-sata-enterprise-hard-drive

https://east-digital.myshopify.com/products/seagate-st16000nm000j-16tb-exos-x18-sata-6gb-s-enterprise-internal-hard-drive-hdd-new

Whats the difference and are these reasonable for a desktop computer? Alternatively what else would you recommend that I can either purchase from Amazon or other website that sells internationally?

640
 
 
The original post: /r/datahoarder by /u/schmitty2535 on 2024-12-18 22:24:01.

I’ve got one user on my Immich server that has 522gb of photos and 202gb of images. Using the Immich UI is nearly impossible since it loads so slowly. I’ve deleted and regenerated all thumbnails at a smaller size and quality but this did not aid.

I’ve seen a link to go directly to the search page, but I often just want to scroll through and browse the library while not looking for anything in particular.

If anyone has any suggestions I look forward to hearing them. Thanks!

641
 
 
The original post: /r/datahoarder by /u/endotronic on 2024-12-18 22:23:31.

The Internet Archive (Wayback Machine) has a number of saved images from Reddit and Imgur, and this is great. However it is far from complete, which makes sense. I'm wondering if there is another archive out there where one can test URLs and possibly recover lost images from Reddit and Imgur.

To be clear, I'm not talking about PushShift data for posts and images, I mean images and albums.

642
 
 
The original post: /r/datahoarder by /u/-ThatGingerKid- on 2024-12-18 22:10:50.

I'm going to finish my home server when I open my Christmas gifts. I had planned all this time to run TrueNAS Scale because it's free and the web ui looks nice. I also intend to use my home server for media serving, NextCloud, Pi Hole, Immich, and probably more.

When I realized how I couldn't just increase the size of a ZFS pool when I got more hard drives, or use different sized drives, I decided that maybe it'd be worth the money to go with Unraid.

I've also been learning and practicing setting up a server / server management on a Hetzner VPS with Ubuntu Server 24 and a mounted Hetzner Storage Box, and I've to realize working in the terminal isn't as complicated as I first thought. I'm not very familiar with setting up hard drive RAIDs on Ubuntu, but I'm not opposed to learning.

What are your thoughts on Ubuntu Server vs a dedicated NAS OS like TrueNAS or Unraid?

643
 
 
The original post: /r/datahoarder by /u/Redkail on 2024-12-18 20:13:49.

Amazon seems to be selling these refurbished hdds for quite a good price, 115€ for 10TB seems like a bargain, reviews seem to be around the 4.2 stars even though there's quite some 1 star reviews stating some problems with them.

Would you consider these refurbished hdds worth it? Do any of you know better places to buy them in Europe?

Thanks in Advance!

644
 
 
The original post: /r/datahoarder by /u/sabotage3d on 2024-12-18 15:35:57.

I am looking at these HDDs as they are available to pickup near me. Are they legit and worth looking into for NAS usage? I can't find much information about these, might be server stripped.

The DELL is manufacturer recertified and the WD ULTRASTAR is just refurbished.

DELL HUH721010ALE600 10 TB HDD

https://preview.redd.it/uf6ic3uxlm7e1.png?width=525&format=png&auto=webp&s=957cbc1e4ae62cfcf136ada57f2b6ea029c06958

WD ULTRASTAR HUH721212ALE604 12 TB HDD

https://preview.redd.it/dfa1mhpjlm7e1.png?width=525&format=png&auto=webp&s=05e32f18cb5132a2801e6ec9cc82b81b44c222c5

645
 
 
The original post: /r/datahoarder by /u/AntiProtonic on 2024-12-18 15:19:06.

Had an interesting thought recently, looking through my Youtube playlist of today, and comparing it to the playlist I had a few years ago (that I'd backed up). Hundreds of videos were missing, primarily of video game soundtracks and such. For many of these videos, I hadn't thought about them for a long time, and if I didn't have that backup, I would've completely forgotten that they'd existed.

Basically, back things up! I wouldn't have had some joyful memories had I not downloaded those songs so long ago.

In an era where the media you enjoy can be lost to time, it is imperative.

646
 
 
The original post: /r/datahoarder by /u/Former-Link4118 on 2024-12-18 15:11:58.

I purchased 4 drives from the Seagate online store last week, and after almost a week of waiting, today I received an email saying the order was canceled due to "unforeseen circumstances". I contacted customer support, and they said it's an "internal error", and I need to place the order again.

The problem is, the drives I bought was a very good deal ($260 for a 20TB Ironwolf pro), and I don't think they want to honor the deal, hence the order cancellation. Quite scummy if you ask me.

647
 
 
The original post: /r/datahoarder by /u/AZ10026 on 2024-12-18 15:01:28.

I bought a 1tb WD my passport a couple of days ago and I just noticed that it makes a click sound when I gently flip it, like the internals are loose and not firm in their place and move with gravity. Can someone who owns one check to see if theirs makes the same sound or not, I need to know if it's faulty so I can return it before it's too late.

648
 
 
The original post: /r/datahoarder by /u/WolfWarrior001 on 2024-12-18 11:25:35.

It still manages to download some things, and it can do mp3 and MP4, all I need is 1080p but it even goes up to 4K (as far as I’ve seen) if the video is in 4K. I saw an old post somewhere about some thing on GitHub but it was all gibberish to me and there was nothing I could find that out it in layman’s terms so now I’m begging here because please I just need to download things why is the site now refusing certain videos? And it’ll do some videos as an mp3 but refuses to do it as an mp4 and others it won’t even give the prompt to download

649
 
 
The original post: /r/datahoarder by /u/Sad_Individual_8645 on 2024-12-18 09:47:50.

So I have a media library that I would not like to lose because it did take me a good amount of time to put it together, but it’s not like I would be “devastated” if it all went away. Everyone is always telling me that I NEED to use the 3-2-1 rule. I currently have a single backup of all my data for each individual type of data (movies/games/shows). The backups are the same exact product as the original which I know is not good since they can die at the same time, but the backup drives have significantly less power on hours than the main drives so I would assume that they will not die at the same time. I basically get yelled at whenever I talk about how I backup my data, but to me going through the effort of getting another drive or different type of storage and moving one to a different location and all of that seems like so much work that I do not want to do or maintain. Am I really gonna end up being fucked if I don’t like people tell me all the time?

650
 
 
The original post: /r/datahoarder by /u/SwellEquis on 2024-12-18 08:14:15.

I'm wanting to save all the contents of a webpage and have the hyperlinks redirect to other saved webpages, kinda like the wayback machine. Is there a FREE plugin. software, or other method that'll let me achieve this? The content that I want saved is private and only accessible through my logged in account on the website, so I don't want to have it be available to the general public if I use the wayback machine on it (if I even could for that content).

view more: ‹ prev next ›