this post was submitted on 20 Jul 2023
664 points (97.4% liked)

Technology

59598 readers
3833 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

Over just a few months, ChatGPT went from correctly answering a simple math problem 98% of the time to just 2%, study finds. Researchers found wild fluctuations—called drift—in the technology’s abi...::ChatGPT went from answering a simple math correctly 98% of the time to just 2%, over the course of a few months.

(page 2) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 8 points 1 year ago

My (random user) opinion is that the answer is a mix between the required computational power being too expensive and thus reduced and somehow how they "fixed" the models so they cannot be "jailbroken"

[–] [email protected] 7 points 1 year ago

GPT was always really bad at math.

I've asked it word problems before and it fails miserably, giving me insane answers that make no sense. For example, I was curious once how many stars you would expect to find in a region of the milky way with a radius of 650 light years, assuming an average of 4 light years per star. The first answer it gave me was like a trillion stars or something, and I asked it if that makes sense to it, a trillion stars in a subset of space known to only contain about a quarter of that number, and it gave me a wildly different answer. I asked it to check again and it gave me a third wildly different number.

Sometimes it doubles down on wrong answers.

GPT is amazing but it's got a long way to go.

[–] [email protected] 7 points 1 year ago

Looks like GPT4 API also got dumber...

[–] [email protected] 6 points 1 year ago

I used GPT4 the other day and it worked perfectly for calculating formulas of straight lines on linear-log plots but maybe I was the 2%

[–] [email protected] 4 points 1 year ago

"AI" taking our jobs and all that huh

[–] [email protected] 2 points 1 year ago (3 children)

Turns out you need very good computer scientists to make good AI. And those are very expensive and hard to come by.

load more comments (3 replies)
load more comments
view more: ‹ prev next ›