this post was submitted on 25 Jan 2024
549 points (97.1% liked)

Greentext

4613 readers
1855 users here now

This is a place to share greentexts and witness the confounding life of Anon. If you're new to the Greentext community, think of it as a sort of zoo with Anon as the main attraction.

Be warned:

If you find yourself getting angry (or god forbid, agreeing) with something Anon has said, you might be doing it wrong.

founded 1 year ago
MODERATORS
 
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 151 points 11 months ago* (last edited 11 months ago) (3 children)

If I had a dollar for every time ChatGPT gave me code that worked but didn't do anything I asked it to, I would have $5. Not because its accurate, but because I only had the patience to correct its work 5 times.

[–] [email protected] 54 points 11 months ago (2 children)

ChatGPT is really good at telling me I'm a dumbass and to do it some other way when I ask why my code isn't working. I'll give it credit for that.

[–] [email protected] 24 points 11 months ago (2 children)

After it gave me to implement X in your app, you need to take into account A, B, and C 5 times in a row when I asked it on what steps needed to be taken, I cancelled my sub immediately.

ChatGPT is getting fucking lazy.

[–] [email protected] 13 points 11 months ago

Much depends on how you prompt. I have definitely encounters this but some basic default instructions around it can tweak it for any usecase.

When i prep a gpt i give it a list of information and steps it is supposed to follow and the further context about the job and my system. Stuff it can assume and what it should never assume.

Creating a good gpt and prompt are alot like programming itself, i can definitely see how if you just want to get some work done that having to do that feels like wasting time but you once a gpt is working its ready to be used any time.

[–] [email protected] 5 points 11 months ago (2 children)

every AI is getting bad. I'm using some off-brand (some might say indie) ones, and they're slower dumber and have more payed options by the day.

ChatGPT if not for cheating in school I wouldn't use it at all probly. Phind.com was my go-to favorite, now can't search the web for shit gpt option is payed and it's just dumb. You.com my friend used this, straight ignored my request yesterday.

do other's have the same experience? If yes, follow-up question are they dumbing down AI, and keeping the power to themselves? 2nd follow-up how can I selfhost a good AI and what do I need for it to work?

[–] [email protected] 4 points 11 months ago (2 children)

Look into ollama and mixtral variants... You'll be limited by things like GPU memory though.

[–] [email protected] 3 points 11 months ago (1 children)

Mixtral 8x7B seems fairly capable to me so far. It's just that I need to wait a few minutes for it to reply, given I'm running it on a 1st gen Ryzen...

Any models you'd reccommend that fit into 4GB of VRAM?

I've tried Deepseek Coder, and it certainly works well for quickly churning out bash scripts for whatever purpose I can possibly think of

[–] [email protected] 2 points 11 months ago (1 children)

Similar story here with an old 10xx GPU. I've just started tinkering with dolphin-mixtral-8x7b, but it's early days.

[–] [email protected] 3 points 11 months ago

Dolphin is just peak amusement to me. I've asked so many weird things of it that it's basically just cowering in a corner now, afraid of answering any question for fear of getting another kitten killed.

[–] [email protected] 1 points 11 months ago (1 children)

what'd you say a good GPU is for it?

[–] [email protected] 2 points 11 months ago (1 children)

An nvidia card with as much memory as possible - the newer the better.

I'm also beginning to look into the dedicated accelerators like the coral, but at first wash, it looks like lack of onboard memory will be a massive bottleneck.

[–] [email protected] 1 points 11 months ago (1 children)

dang, I got an amd one. Should I even try? (16GB)

[–] [email protected] 2 points 11 months ago

That I don't have any experience with - I hear it's harder, but not impossible.

[–] [email protected] 1 points 11 months ago (1 children)

Perplexity and poe are my go to for this.

[–] [email protected] 1 points 11 months ago (1 children)

I'll try them tho, already a + for perplexity, I don't need to log in

[–] [email protected] 1 points 11 months ago

Yep that one my current fav.

[–] [email protected] 1 points 11 months ago (1 children)

Does chatgpt ever ask follow up questions to follow up on persistent problems? No, right?

[–] [email protected] 1 points 11 months ago

I don't think I've ever had ChatGPT ask a followup question. It just kinda runs with what you gave it. Maybe if you don't tell it much of anything it will ask, but I usually supply it with everything it could possibly need.

[–] [email protected] 14 points 11 months ago (1 children)

Boilerplate that I know by heart but can't be giving bothered to type? Sure.

Context specific, unique manipulations? Nah, in going in raw

[–] [email protected] 5 points 11 months ago

I can't speak for GPT, but I usually let copilot take a first pass at things, then when I start to tweak them to fix Copilot's mistakes, the AI peer-codes it out with me pretty quick.

I've actually managed to get copilot to offer a valid solution to a problem that was cleaner than my own (though it took a few tries).

Dev AI's work and save time as long as you know what you're doing and aren't trying to lean on the AI to do all the coding.

[–] [email protected] 13 points 11 months ago

I had a similar experience.

You know what's nice tho? Vscode copilot.

It gives auto complete suggestions like many systems already do. But it also learns from your script and suggests code in your style.

Even ignoring bad suggestions it's helped me a ton and paid for itself. Worth the $10.

My coworker asked for a script and I made it in an hour for him. Dude tried to call me out saying I had it already. Looks like at least a days worth of work.

"Nope. AI baby."