It's A Digital Disease!

11 readers
2 users here now

This is a sub that aims at bringing data hoarders together to share their passion with like minded people.

founded 2 years ago
MODERATORS
151
 
 
The original post: /r/datahoarder by /u/Anthrac1t3 on 2025-01-02 18:17:48.

So like a lot of people here I have a stack of family VHS videos I want to digitize. I'm looking to get them loaded up onto my Plex server for my family to enjoy. I've been playing with a few different ways of doing this. It started with a RCA DSP3 and the Elgato RCA to USB capture card but I was having issues with skipping and just didn't like the quality. So then I got a Panasonic PV-V4612S and wasn't happy with the either. Then I decided to get a Sony SLV-R5UC and did the blue gear repair and rebuilt the power supply. Then I found out S-Video capture wasn't working on the Elgato card so I grabbed a Black Magic Intensity Pro 4K. Now Instead of skipping, wobbly, and low color videos I have skipping, wobbly and gorgeous videos. I'm using OBS for capture since I have used it before and am decently familiar with it but the more I read about VHS capture the more I realize I have no clue what I'm doing. The vhs-decode README has me fried and I don't even think that is a route I can go down for $500.

Please help me. I've been working on this project for over a year now.

152
 
 
The original post: /r/datahoarder by /u/Saturn_to_the_Moon on 2025-01-02 17:28:29.

I got pretty shit on with my previous post, so here's me attempting to rectify that. You nerds are way more technical than I had realized.

https://www.reddit.com/r/DataHoarder/comments/1hraqx3/finally_set_up_my_vhs_to_digital_conversion/

So I'll heed some of yalls advice.


First off, this is what I have:

  • VCR: Panasonic PV-9661 ( No S-Video Out ) Seems to be working decently. A little dusty, so could probably use a cleaning.
  • A mini PC with only usb. ( I do have a server that I could potentially put a PCI-E card into, and run a VM and attempt to get pci-e bypass working, which would be a huge pain in the ass that I'd rather not deal with, unless there was some sort of docker container solution I could use with it )
  • Sony Handicam DCR-TRV11 ( It appears to be very broken, no power cables or anything, and its pretty smashed up )
  • My generic easycap clone that apparently isn't worth its plastic.
  • Most of my home movie tapes are VHS-C, the others are Mini-DV,
  • I have a "VCA 115A Cassette Adapter" so I can watch the VHS-C tapes on a regular VCR player. Seems to be working fine.
  • I currently don't have any way to view/play the Mini-DV tapes.
  • Visually all my tapes seem like they are in reasonable condition, they've been stored indoors in cabinets for most of their lives.
  • ( all data will be stored on my unraid server, which currently has about 17tb of free storage )

What I understand

  • Not much.
  • I'm a 90's kid, and my only knowledge of VCR Tech is that the purple tape played barney.
  • My current $10 capture card sucks, because from what I understand, it can't properly convert the analog signals to digital, and causes loss of quality/colors, and ( as I'm experiencing a little bit ) some audio sync issues. ( though mine aren't bad, maybe a half second off at most, you only notice if you're actively looking for it )
  • That I need a better capture card
  • The only way to watch a Mini-DV tape is with a working camera

My goal

isn't to have lossless 1:1 quality. I understand the benefits of that, but really 'good enough' is fine for me. The realistic truth is that I'm just going to upload all these to youtube for my family to watch once or twice on their phones. While the RF stuff seems neat, I don't really have a desire to gut a vcr player, learn coding, and buying another HDD or two for my server to store that much data, then spending additional hours editing and pulling in the audio tracks.

I also don't care about hunting down 20 year old PCIE cards that only work on windows XP and all that mess.

I don't care about trying to view the footage as it was originally shot, its home movies, not art. I just want to watch it on my modern TV, and share it with my family via youtube.

I'd really like the set up to just be: hit record on the PC, insert tape, and press play.

Its a nostalgia trip, not analyzing the zapruder film for the man on the grassy knoll.


My plan

Using whatever set up I end up getting, simply go through all 100 or so tapes, and record them to my server. I WFH so it would be pretty easy to just let them do its thing while I work.

Later I can filter out stuff I want to keep from stuff I don't care about ( recordings of tv shows, etc. )

The physical tapes I'll label with their contents, then store each of them in a ziplock bag, and get me a nice drybox to store them in.

Then eventually use Premiere Pro to cut the footage up into their smaller segments, see what improvements I can make with software editing and do my best to label them with the correct dates, and be able to host them on my plex account and share to my family via youtube.


TL;DR

Lets say I have a budget of $100 for this project. Could be convinced to spend $150. Looking for the best usb solution.

I know I need a better capture device, and a working camera or other solution to be able to watch the Mini-DV tapes.

I'll keep an eye out for a VCR with S-Video out, but I live in a very hipster town, so good VCR's are hard to come by.

Thanks nerds. you've enlightened me.

153
 
 
The original post: /r/datahoarder by /u/Sir_Krinkly on 2025-01-02 17:21:55.

To the magnificent people who posted torrent links for all Mr. Rodgers and the vast majority of Sesame Street. Took me a while but I downloaded it all and naturally am making sure it’s there for others. Both of these are such treasures.

154
 
 
The original post: /r/datahoarder by /u/nomanfakename on 2025-01-02 17:11:33.

WFDownloader i believe is better then J2 . I just need help fixing this . They don’t have a discord server or tele so no way to ask for help . Wondering if anyone else has ran into this same issue

any help is much appreciated

155
 
 
The original post: /r/datahoarder by /u/StreetSquare6462 on 2025-01-02 17:00:33.

I've got myself two 2TB 2.5 inch SSDs. Im looking for a way to use these as a synced backup with my laptop. Is there maybe like a good dock or something? What are your thoughts?

Thanks in advance

156
 
 
The original post: /r/datahoarder by /u/c4pt1n54n0 on 2025-01-02 16:49:23.
157
 
 
The original post: /r/datahoarder by /u/T0XiiC27 on 2025-01-02 16:40:25.

Hey!

The case looks very appealing to me, lots of space etc. but theres just one question.

To anyone that owns or owned a meshify 2 case, how are the HDD noises? I dont need it to be dead silent but somewhat silent so it can be in the living room without any disturbance.

158
 
 
The original post: /r/datahoarder by /u/CalamitousCalamities on 2025-01-02 16:27:28.

Seemingly there's only around 180 tapes converted since IA acquired them, and no tapes have been added since march 2019? (The file naming schemes used are atrocious as well) Does anyone here have any insider info on the project? I wish I could help them!

159
 
 
The original post: /r/datahoarder by /u/UssKelvinTR on 2025-01-02 16:03:43.
160
 
 
The original post: /r/datahoarder by /u/jaymeh on 2025-01-02 15:30:02.

Hi everyone, I'm not sure if this is the best place to ask but I've started ripping a season of Yu-Gi-Oh from DVD.

Whilst checking over my results I found a few frames that don't quite look right. I've used MakeMKV to pull the RAW file directly from the DVD and here's an example: https://share.cleanshot.com/mPvrlMw7W8znWrJ6J5dS

I've also tried running it through handbrake and setting some deinterlacing options up however I'm still seeing the same issue. Here are my handbrake settings for reference: https://share.cleanshot.com/hvkPcsf8vkcljVQXLDtr

Is this something that Handbrake can account for with some other setting?

161
 
 
The original post: /r/datahoarder by /u/zuckerberghandjob on 2025-01-02 15:15:36.

I’m looking to set up automatic backups for my NAS to an external drive. I’d like to use an actively cooled enclosure rather than the heat coffins that the drives come in. I found a few 3rd party enclosures with built in fans, but it seems like they all require you to manually turn the fans on and off. Does anyone know where I could find an enclosure with a built in thermostat or something to automatically control the temperature?

162
 
 
The original post: /r/datahoarder by /u/Flelmo on 2025-01-02 14:40:32.

A follow up to this post: https://www.reddit.com/r/DataHoarder/comments/1ge3zyb/8_bay_alibaba_case/

At the end of November, I got a coupon for $20 of shipping from Alibaba, so I impulse bought this case (well, sort of). I actually bought it from a reseller on Alibaba, with a 300W Flex PSU pre-installed. It came in on December 30th, so I immediately swapped my NAS setup over to the new case, from my current Fractal Design Define R5 (which is now for sale).

My current NAS setup, for reference only. This is a non-critical NAS for me, I use it for media storage only, and if it dies, I won't be upset:

  • i5-8500, Gigabyte B360M, 32 GB DDR4 RAM
  • HP 530T Dual 10GB Ethernet Card (this was a pain to get running, I had to do the tape trick on Pins 5 and 6)
  • Proxmox OS, with TrueNAS Scale running as a VM
  • 4 x 14TB Drives, 3 x 12TB Drives, running on a 9211-8I HBA in IT mode, passed through to TrueNAS

So, notes on the case and overall experience:

  • Timeline: 11/26 I placed the order/paid. I talked to them for 2 days, ironing out the PSU questions (see below) and verifying I wanted ocean shipping. The case shipped on 11/28, was on a boat on 12/4. It arrived in the US (Ontario, California) on 12/19 and was tendered to UPS. UPS delivered it on 12/30. I had to extend the delivery confirmation and ask the seller to extend the delivery confirmation as well.
  • The 300W Flex PSU was a $30 upgrade. I decided to go for it so I wouldn't have to do research on Flux PSUs and hope to get one with enough power cables. When talking to them, they said the PSU was 220/240V only, and it would be an extra $13 to go to a 110/120V PSU. I declined, and told them to give me a refund for the difference. Instead, they "upgraded" me for free. When the unit arrived, the Flex PSU installed was rated for 110-240V, and it came with a European style plug on the power cable. I don't know if they were trying something, or this is definitely a different PSU than it would have come with otherwise.
  • I paid a total of $165. $139 for the case with PSU, $14.30 for shipping (after coupon), and $11.50 for tax.
  • Communication was good throughout.

First, the good:

  • The packaging was decent. The box was oversized, thick cardboard and they used soft foam inserts to keep it in the center of the box. There was a hole in one side of the box, but since there was a large amount of space there was no damage to the case.
  • The case is solid. No real large complaints on the quality/manufacturing here, but thermals might be an issue over time.
  • I was impressed with the standoffs on the tray. They had aluminum standoffs built in. Both tall standoffs, then short standoffs where you could install (provided) brass standoffs depending on exactly where your motherboard mounting holes were. It says it supports ITX and MicroATX, I had a MicroATX motherboard.
  • There was a decent amount of space around the PCIe slots (4 provided). There's definitely room for a decent sized GPU.
  • Installation of the hard drives into the caddies and case was fairly straightforward. This is not a hot swappable case, but I knew that going in.

Then the okay:

  • The accessory box was fine. I didn't actually expect one, so the fact I got one was nice. They included screws for all the hard drive caddies, as well as stick-on feet if you wanted to use the case vertically.
  • The PSU is... Fine. It has the standard 20+4 motherboard power, 4+4 CPU power, another 4 pin ATX, 3 molex, 2 SATA, and 1 floppy drive connector. The molex cables were pretty short, however.
  • The display doesn't really do anything. If I did it again I would get one without the display. It just displays the case temp and the fact the fans are running.
  • As expected, there's not a lot of room. I'm going to have to go to 50cm SAS breakout cables from 1m ones, they're just kind of bunched up in there right now.

Then the annoyances:

  • It comes installed with 4 80mmx25mm fans. The two on the backplane are attached to the display PCB via 3 pin cables, and the two on the back of the chassis are powered via Molex. So no easy way to do fan control. The fans on the back chassis are easy enough to swap, but the ones on the backplane seem to be much more difficult, needing to remove the entire drive cage to do so.
  • The tray is good, with two large captive thumbscrews above the motherboard I/O and the PCI slots to release it. However, there are also two small screws on the bottom of the case holding it in, which to me defeats the purpose of having the thumbscrews. Either you need to keep the bottom screws out to use the thumb screws only, or you need to flip the case every time to undo the small screws.
  • They supplied 2 Molex Ys with the case, but it was still a juggling act getting everything powered, especially since the molex power cable from the PSU was very short. The case wants 4 Molex for the backplane, 1 for the rear fans, and 1 for the front display. I'm swapping the back fans for motherboard-controlled fans to get around this.

So, overall impressions are good. I wouldn't do the front display version again, but I'm overall satisfied (so far). I didn't take any pictures because I was too excited to get my setup moved over.

163
 
 
The original post: /r/datahoarder by /u/Horrigan49 on 2025-01-02 13:49:58.

Hello,

First, a bit of introduction. My name is ~~redacted,~~ and I am a data hoarder. I have been that way for a long time but always used makeshift solutions. After years of careful NotDoingAnything I wanted to give my passion a form, so lo and behold, Jonsbo N5. It made landfall in the EU last December.

Cheers to casekind.de for this NotFree sample, which still saved me at least 100€/$ on shipping and mental health costs of dealing with ALiExpress. I have waited for half a year, but it was worth it.

N5

Along with

  • i5-14600T
  • Gigabyte B760 DS3H DDR4
  • Random DDR4 lying around (will get upgraded from the current NAS once finished)
  • Seasonic Prime 650W platinum from my old PC
  • Few 12cm and 14cm Noctua Fans
  • Spare 2 Axagon PCES-SA6 SATA controllers
  • MANY SATA cables

we have this nice little box. Yes, I realize that only some parts are new or "in form" but I like to give older parts some purpose as I don't like dealing with marketplaces I tend to hoard parts as well. (Also reducing my carbon footprint! /s)

For the operating system, I have chosen Unraid as it has a very nice OOB experience, configuration Is easy to backup and with docker in general features I would need.

If you have read this far, you have to keep asking "Where are the drives? Which brand? How many?" Yeah, that would be my question here. Thanks to this subreddit I have discovered that decommissioned data center drives are a thing and that shops like serverpartdeals.com exist.

However the idea of drives being shipped over the ocean from the US to the EU and if things go back, the other way as well is not something I am looking forward to. Also, the amount of drives I am looking for around 5 or 6 perhaps 7, will get me 21% VAT and also around 8% customs tax. Including shipping from the US those awesome prices on serverpatdeals are not so awesome anymore.

So there comes the quest for serverpartdeal but in the EU. I have checked a few sites suggested on this sub but either the prices were not really THAT good or any good or their selection was poor. I have checked with my local HW supplier, but we are a small market here.

By chance, I have stumbled upon this shop from Spain. give1life.com which is an odd name but ok, I've seen worse. Has anybody bought something from them?

The reviews seem to be a mixed bag but their selection and prices look reasonable. We are the same Tax and customs union, so the prices are final for me (+ shipping)

What would you pick up from this offer?

https://www.give1life.com/categoria/discos-duros-3-5-lff/?orderby=price-desc

I am looking for a target of around 50TB with parity in the Unraidbox above.

Thanks

164
 
 
The original post: /r/datahoarder by /u/Sempiternal-Futility on 2025-01-02 12:21:40.

Are 3.5 HDDs more reliable or sturdier than 2.5 HDDs?

I see that 2.5 ones are cheaper, so I don't know if that comes with a downside or not.

165
 
 
The original post: /r/datahoarder by /u/WikiBox on 2025-01-02 10:47:11.

This is an informal survey to find out what the most common reasons for data loss are, among the data-hoarders who answer.

It is assumed that the data loss was permanent, no recovery from drive rescue, backups, snapshots, redundancy, re-download.

If you never experience data loss, or did so using some other cause, please comment why/how.

What has caused you the most/worst loss of valuable data in the past?

View Poll

166
 
 
The original post: /r/datahoarder by /u/Shepardasz on 2025-01-02 10:12:18.
167
 
 
The original post: /r/datahoarder by /u/Competitive_Fix3519 on 2025-01-02 07:41:37.

I want only the images, also I would like to title the saved images by post title. Any tools to automate the task thanks in advance

168
 
 
The original post: /r/datahoarder by /u/thedazellama on 2025-01-02 06:20:40.

I'm a data hoarder. I want to build a software product (described below), but I really don't want to build something nobody wants, or that someone has built before. Pinboard, Linkding, Evernote, Instapaper, Pocket, et. al. aren't working for me.

I need backups of my bookmarks/hyperlinks. At this point, bookmarks are "my corner of the internet", and the internet is basically a lobe of my brain.

This is what I want:

  1. I save a url. The url is cleaned of unnecessary SEO bullshit. A snapshot of the web page's source is saved for my private reference. A "readability" version is created.
  2. De-duplication is automatic.
  3. I can write a note to self. I can highlight text.
  4. If it looks like an article (e.g. long form, mostly text) readability version is the main version.
  5. If it looks like a product (e.g. there's a price, buy now button, etc.) the price is surfaced at the top level and the page is crawled periodically to check for price changes or sold out status.
  6. I can share it with a friend, and they can comment on it. Maybe we can have an entire private discussion about the url, and that context/metadata is saved.
  7. I can hook into LLMs to generate sensible descriptions and tags.
  8. I can install extensions for most major browsers, and sync with the browser bookmarks. I add a browser bookmark and it's automatically added to my collection/vault.
  9. I can authenticate social media (e.g. Twitter) and every time I bookmark or favorite a thing, it is backed up.
  10. I can opt in to a daily/weekly email that shares n random links with some context for me to revisit the link, decide if I want to take action (read the article, buy the product, delete the bookmark, write a note to self on it).

I want this to run in the browser, but great iOS and Android apps are a must, and a super fast, native desktop client would be a stretch goal.

Finally, I'd like to be able to subscribe for this functionality for a little amount of money per month, or buy it once and self-host it for a slightly larger amount of money (a year or two of updates included).

Please A) tell me this is already built so I can use it, or B) tell me I'm an idiot for even considering building this, or C) tell me you would pay for this. The more context you're willing to share, the better.

169
 
 
The original post: /r/datahoarder by /u/Thitted on 2025-01-02 06:08:34.

Also posted this in the windows sub but figured posting here would be better off. I was just working in FL studio when my laptop started cutting out and the screen said "locking" then shut down completely out of nowhere. I presume the laptop overheated and haven't tried rebooting it yet, but my question is if the laptop shuts down in this manner is it safe to remove the hard drive without loss/corruption of data? Also would it be risky to boot with the external drive still plugged in? Any help would be greatly appreciated 🙏

170
 
 
The original post: /r/datahoarder by /u/Level_Mixture_9533 on 2025-01-02 05:37:03.

I have access to GCP but the download costs would be enormous.

Every day there will be an extra ~5-10gb of jsons archives and I want to give people the option of downloading them, wondering what the most efficient way of doing this is for non for profit org?

In a year there will be around 2TB of data so just thinking a bit a head.

Disclaimer: I'm not rich

171
 
 
The original post: /r/datahoarder by /u/No_Independence8747 on 2025-01-02 05:00:28.

I just discovered download managers are a thing. They look promising! I tried to use a few with protected files on archive.org but I keep getting error messages. I put in my username password combo and nothing changes.

Is there a way to use a download manager on protected archive.org files?

172
 
 
The original post: /r/datahoarder by /u/341255 on 2025-01-02 03:18:47.

hi everyone . i want to share some tips when using gallery-dl . gallery-dl is a great tool but there are some problems with the file download options .

  1. the --no-download option will skip downloading the file . the problem is that it will still write the file to the archive file . you can combine the 2 options --no-download --download-archive "" to skip downloading the file and not write to the archive file . similar to the --skip option of yt-dlp .

    1. you want to redownload a file that is already saved in the archive file ? . when i searched for information the creator said to use the -o skip=false option . the problem with this option is that it will overwrite the existing file . if you have 100 images of 10mb/image and accidentally deleted 50 images and you want to redownload those 50 images . -o skip=false will redownload NEW 100 images . The solution is to use the --download-archive "" option. same as the --no-download-archive option of yt-dlp.it will redownload 50 files and if the file already exists it will skip downloading. saving a little more time.
173
 
 
The original post: /r/datahoarder by /u/Assist-ant on 2025-01-02 02:17:40.

I know that dvd and blu-ray have menu system support for playback allowing choose your own adventure style playback (Dragon's Lair, Space Ace) and want to know if anyone is familiar with an authoring software that can handle the choice layering that takes place in Netflix's Jabberwocky so that I can make an iso that can be played on pc or burned to disc and played in a blu-ray player

174
 
 
The original post: /r/datahoarder by /u/xnbxb on 2025-01-02 00:11:13.

I have these image URLs which seem to indicate the resolution of the image in the URL:

https://web-images4.pixpa.com/KT8m-hdiWrUHTIEH7tyCsWjI8tBNVd9Vdxb3qMmHook/rs:fit:2048:0/q:80/czM6Ly9waXhwYS10ZXN0L2NvbS9sYXJnZS82MzQwMTQvMTcwOTU1MTU3OC0zMzIyOTItY2FzYTQ4LTIuanBn

Is there a way to modify the URL to get the maximum resolution? Nothing I've tried so far has worked.

175
 
 
The original post: /r/datahoarder by /u/Mean_Assignment_3607 on 2025-01-01 21:12:37.

Im a videographer and recently got a 360 camera that takes up a lotttt of storage. I’m going to need an external hard drive to store all of the video files. I also need it to easily connect to my MacBook for editing and transferring. I would prefer to spend no more than 100, but I know that’s a hard ask for these things. Anyways, any recommendations would be great. Thanks

view more: ‹ prev next ›