this post was submitted on 14 Oct 2024
16 points (76.7% liked)

Asklemmy

43870 readers
1363 users here now

A loosely moderated place to ask open-ended questions

Search asklemmy ๐Ÿ”

If your post meets the following criteria, it's welcome here!

  1. Open-ended question
  2. Not offensive: at this point, we do not have the bandwidth to moderate overtly political discussions. Assume best intent and be excellent to each other.
  3. Not regarding using or support for Lemmy: context, see the list of support communities and tools for finding communities below
  4. Not ad nauseam inducing: please make sure it is a question that would be new to most members
  5. An actual topic of discussion

Looking for support?

Looking for a community?

~Icon~ ~by~ ~@Double_[email protected]~

founded 5 years ago
MODERATORS
 

I'm looking to get my first subscription of a machine learning model and I've been using POE for a while but I'm not sure if paying for it would be better than paying for a GPT subscription. I almost never use them to generate images, mostly for help with my business and some programming.

I also want my wife to be able to use the same account when I start paying for it.

I'm not sure what the benefits of each are and which would outweigh.

you are viewing a single comment's thread
view the rest of the comments
[โ€“] [email protected] 32 points 1 month ago (1 children)

Honestly, all of the generative AI subscriptions are pretty fucking steep at this point compared to just running a model locally.

[โ€“] [email protected] 2 points 1 month ago

I agree with this. I'm using a 1070ti for image gen and it would be more than capable for handling some LLM stuff. An AMD 7700xt ive found dors well with 7B models on my main rig but im sure you could get away with somthing cheaper or less powerful.

That said, the amount of text you can genrate or the context length of its answers will depend the model you use and the larger the model, the more power it takes.

If youre just messing around with it or want it to review or answer small questions, I'd say a 1070ti like I'm using would be just fine. Some folks use even more budget friendly options. If you got a gaming machine with any semi recent GPU, I'd say go for it. Worst case, you can pay for a subscription later if you really want.