How do you avoid "hoarding"?
Looks at my 28TB storage array that's 3/4 full...
1. Posts must be related to the discussion of digital piracy
2. Don't request invites, trade, sell, or self-promote
3. Don't request or link to specific pirated titles, including DMs
4. Don't submit low-quality posts, be entitled, or harass others
📜 c/Piracy Wiki (Community Edition):
💰 Please help cover server costs.
Ko-fi | Liberapay |
How do you avoid "hoarding"?
Looks at my 28TB storage array that's 3/4 full...
Time to buy new HDDs.
You're doing great man, please keep it up i'm not even joking. Maybe someday you'll be the one guy that still has that old gem everybody lost.
I actually keep a list of works that I've shared online that would've likely been lost without my intervention. Physical-only Bandcamp releases that I've ripped and shared. Sample packs that have been taken down from webstores, etc. The Internet isn't forever people. Better archive what you can
Avoid hoarding? Let's just say I bring a real "gotta catch em all" energy to the trackers.
How do you avoid "hoarding"?
I dont. Hard drives are increasingly cheap/large. I have to really dislike something to delete it. I have a fair amount of content that I don't really plan on watching again, but someone I know might like it so i just leave it typically.
These are my thoughts exactly; piracy is preservation.
I have to really dislike something to delete it.
The velma tv show was the last item I just deleted.
But for me this is the same story. I'm up to 400TB... I'm just over half full. I've got plenty to go, and if I make to to 75-80% full, then I'm going to get me a 45 or 60 bay server and upgrade from my 36 bay one. 6 of the bays are wasted on SSD caching currently... Just finding a chassis that doesn't waste the 3.5 inch bays on 2.5 drives would allow me to add a full vdev(another 100TB...).
Old chassis can be had on ebay relatively cheaply.
Do you have an offsite backup? Or do you only backup specifics? Like 10-20% of that?
I do not have full proper offsites... yet.
I run proxmox, so if it's live on a server it's probably on my ~70TB (really 40*2TB ssd) ceph cluster. Which makes 3 copies across the 5 boxes, so it's more like 23TB of usable space for all my vms and such. The 400TB of storage is Truenas is really closer to 300TB after all the losses in raidz vdev and hot spares and what have you, there's 30x 16TB SAS seagates in the box, of which 2 are hot spares and 7 are parity for raidz1... For things that are slow or linear loads (a movie file could be a good example of that type of workload!). Backups of the the proxmox boxes... and mass stored stuff, 99% of it I could easily obtain again if I had to. Although I'd probably be pretty flustered about it.
Truly important stuff gets written to 100GB bluray(s) (specifically m-disc blurays) and put in the safe. I do this probably about once a year or so...
My dad was in the process of setting up his own cluster that's running 14TB drives rather than my 16TB... When he's finally done I intend to requisition probably about half of his space for offsite storage (maybe more). I'm figuring about 100TB of space is what I'll have there. Maybe more. He's about 65 miles away from me, different electrical grid and all.
So the count as it stands now. Everything running has at least 2 copies on 2 mediums (ceph cluster, and spinning rust). My "linux iso" repositories only live on the spinning rust storage, but is low priority anyway. Super important highly sensitive shit lives on at least 3 copies and 3 mediums, although one of the mediums may be out of date and none is offsite... Though it's rare I add to this category. There is plans for adding another copy of data, offsite on harddrive storage for most of my dataset as it is now.
Truenas usages:
And here's Ceph
My goal is to store everything, that way I have no dependence on remote media
Home datacentre 😋
Well yes, but also actual DC space lol
who avoids hoarding? we are saving it for the future.
Exactly! I assume that my little 4tb external drive full of movies will one day be the only usable relic discovered of our civilization, so I must plan accordingly lol
Avoid hoarding? I don't understand. My 30 TB file server can be expanded further still.
All the time. It's my primary source of entertainment media. And why would I want to avoid hoarding? Hoarding is the goal.
Storage is cheap. There’s no reason to delete content.
Only reason I delete content is when I upgrade. Like replacing a low resolution version of show with a higher one. Still, I keep immutable "snapshots" of my entire media folder so even after deleting something, It'll stick around for at least 6 months in case I need to restore it.
There's no reason to avoid hoarding!
I only pirate TV/movies, and since I never know what I’ll feel like watching it’s pretty easy to just hoard it. Takes a long time to fill up drives so adding a 16TB drive once a year or two is pretty manageable.
But tbh the main reason I hoard them and keep my Plex library full is simply to keep view stats. Prior to Plex I was constantly plagued by “have I seen this” or “what was that movie I liked 10 years ago?”. But not anymore!
Also, when the zombie apocalypse happens I’ll finally have time to rewatch Breaking Bad so I need an offline copy just in case.
Or when streaming services start at $70.00 a month with ads.
I only pirate what I'm about to consume? How is this a problem? Lol
I have a lot of ebooks that I download for university research, hobby learning and friends who ask for help sourcing books. I put everything in my calibre library, which is great for metadata management (tip: I have it set so new books that I've just imported get a tag of "new", which I remove when I have processed their metadata. This allows me to chip away at ensuring the metadata is correct and good, even if I don't do it at time of import).
Anyway, at one point I found myself at risk of becoming overwhelmed by books, because if I'm wanting to learn some category theory, for example, I'd have multiple books that seem to be relevant. Some of them were recommended by programmers, some of them assume a higher level of maths background knowledge, some of them are more fun to read — once upon a time I might've known which was which, but if there's a significant gap between me downloading stuff and using it (which is often the case, I'm quite opportunistic with book recommendations), I may forget. Making a note of why I downloaded a particular book is something I've been trying to do more, so I can identify the useful things at the right time — the calibre notes field can work for that, but I'm still figuring out how to manage this in a wider sense because I do a lot of reading and it's easy to forget why I'm reading a particular thing. I think I have a calibre plugin to show which things I've read also.
Another related thing is that I will take a cursory look over a book when I download it, and I may delete it and not put it into my calibre library. This feels significant because downloading a book doesn't make it one of my books, 'taking it home' and putting it away on my 'bookshelf' makes it mine. In short, I try to be mindful in my curation activities, recognising that doing it in big clumps with my whole collection doesn't really work and that pruning little and often helps more.
Thanks to MetalJesusRocks, I just grabbed a pack of 7,000 MS DOS game (ExoDos) at almost half a TB
help me
That's like 70 MB per game unless my napkin math is off by a few 0s. Sounds rather large for MS DOS games?
How do I avoid Hoarding? Well I have a total of 2.75tb of space, so when it gets a bit full I go through and delete shit we watched already so I have space for more stuff
No issue hoarding if you're seeding
Haha, good question. You're not alone with that. I suppose you just clean up once per year. Like you're supposed to do with your wardrobe, or that one drawer in the kitchen...
I usually just pirate ebooks, rarely videos or games, so my piracy doesnt take up much space. For videos I just keep em around since I have the space, and if i need to clear space I can just delete something I've already watched. And tbh I don't remember the last time I pirated a game, I don't play games a lot and the ones I do play I own legally lol
Oh I do pirate music too. It's currently not taking up much disk space so I'm not bothered. I would probably just buy another drive if i ran out if music space.
I only pirate music and books anymore. I do consume it all. Well, most of it. Sometimes I'll download a series of books and not jive with the first one or something. The music always gets listened to. More than once, too! I'm easy to please. Or I have good taste.
I have two servers, a >100TB rack-mounted Supermicro archive that doesn't get fired up often, and an Intel NUC that runs 24/7 but only draws 5W at idle. The NUC with its mere 4TB SSD is only for content I'm actively watching which gets deleted immediately afterwards. Running just the Supermicro made more sense when I had a terrible internet connection and had to wait for everything but I moved to an area with 1Gb+ connectivity a few years ago and subsequently needed to save on energy costs.
I feel like the real question you want to ask yourself is, "how likely is it that this particular content will still be available on Usenet/torrents in a few years?" Some stuff is much more niche and rare while other movies/shows each have over a dozen redundant releases, at least a few of which will more or less always be available somewhere. To put things in perspective, it also helps to do an analysis of how much you're spending each month in order to avoid what you would be paying in streaming and licensing costs, including hardware, power, and connectivity. If that ratio gets too high then it's time to scale back.
I'm concerned that crackdowns on pirating will come sooner or later. At some point it may become too much of a hassle. So I'm hoarding a lifetime of old movies and games to hold me over.
Just keep seeding the torrents. As long as the torrents for stuff is healthy, how could it be cracked down?
If i need something, i go look for it, download it and keep it seeding until i have no more space on my hard drive. I rarely download things i don‘t actually need or want at the moment.
I only dl shit i'm interested in. After watching if it's gonna be rewatched, it goes on the fserve. If not, delete
I archive, never delete or stop seeding. I would just delete when you need space if you don't want to buy drives.
I avoid hoarding by only grabbing things I know I'll use. With movies/shows, if I haven't used it in three months, it goes away. With music, I tend to go in cycles through genres where I'll be vibing to a given type of music for a month or two, then switch things up. So the cutoff is much longer, years in fact.
But books are a slower thing to begin with. I'm a notoriously fast reader, capable of consuming light fiction at a book and a half to two books a day. Something like the Sookie Stackhouse books by Charlaine Harris, as an example, I can zip through the entire series in under a week if nothing interferes. But even at that speed (which isn't consistent when there's heavier material), it would still take years to go through my digital library. Plus, the files are small enough that I don't have to worry about the space, so they only get deleted if I dislike something new.
The exception to all of that is some classics that I keep around just for the hell of it. Like, I have all the Hitchcock movies, but only watch any given one maybe once in five years. So I still have most of a terabyte of movies that's as permanent as possible barring redundant storage all failing at once.
Music is similar, especially since most of it is in flac format. There's some stuff I may not listen to often, but I want to keep immediately available.
Which, believe it or not, isn't hoarding. I go through things and weed out fairly regularly. It's just that after a collection is big enough, it takes longer to cycle through and use a given file again. Stuff that's used isn't hoarded.
I'm mostly hoarding this stuff because I have no fucking clue.
what is the problem?
I watch movies and series once, and keep them on my hard drive until I'm running out of space, then delete from the oldest to newest. Music I'll consume very regularly.
I mostly only load TV shows and movies. At least those are by large the biggest part in terms of storage taken. Well.. I only load stuff that I actually want to watch. I also load some stuff for friends, but it has to be decent quality and be not totally niche (aka I'm eventually watching it, or other friends)