26
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
this post was submitted on 27 Sep 2024
26 points (96.4% liked)
Hardware
491 readers
225 users here now
All things related to technology hardware, with a focus on computing hardware.
Rules (Click to Expand):
-
Follow the Lemmy.world Rules - https://mastodon.world/about
-
Be kind. No bullying, harassment, racism, sexism etc. against other users.
-
No Spam, illegal content, or NSFW content.
-
Please stay on topic, adjacent topics (e.g. software) are fine if they are strongly relevant to technology hardware. Another example would be business news for hardware-focused companies.
-
Please try and post original sources when possible (as opposed to summaries).
-
If posting an archived version of the article, please include a URL link to the original article in the body of the post.
Some other hardware communities across Lemmy:
- AMD
- Gaming Laptops
- Laptops
- History of Computing Hardware
- Linux Hardware
- Mechanical Keyboards
- Microcontrollers
- Monitors
- Single Board Computers
Icon by "icon lauk" under CC BY 3.0
founded 1 year ago
MODERATORS
Compared to 24gb we had in 2020 that's barely an upgrade. I'm not joking, AI stuff needs more VRAM. 32gb is too little for the price they'll ask for. Right now VRAM is more important than pure power, you can't use larger models when your VRAM bottlenecks.
Edit: oh I get it. I mentioned AI my bad.
We had GPUs with 24GB in 2017, go buy a pro one if you do AI and need that much RAM.
I mean, those cards are for gaming, right?
RTX3090 with 24gb VRAM was the best you could get as consumer GPU. Not sure which 2017 GPU you mean but it certainly was a completely different price range and not for gaming. It would be the same as comparing it to an A100, makes no sense.
A lot of people can't afford two PCs or a GPU that costs 10 times as much, so obviously the GPU needs to be good for gaming and other stuff. I only voiced my opinion after all. If you don't need more VRAM, that's fine. I however don't have an unlimited wallet and VRAM should be higher for the asking price they have, but again, you can disagree if you think it's fine.
No problem, but I mean if you're just tinkering around then you could do with even less memory as long as the model stays in it and you sample small pieces in small batches.
We all had P series gpus and we had to buy up because the trainees model didn't fit in 16GB (they had probably too much money) so I don't remember what card it was for the 24GB.
For just tinkering around one could use SD1.5 with a 4GB VRAM GPU and stop after a few minutes. I spend quite some time on AI image generation, like on average 4 hours per day since over a year now. New models, especially video AI generation will need more VRAM, but since I don't do this commercially, I can't just pay 30k for a GPU.