this post was submitted on 21 May 2024
120 points (86.6% liked)
Technology
59366 readers
5942 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
You must have one person constantly checking for hallucinations in everything that is generated: how is that going to be faster?
Sure you sort of need that at the moment (not actually everything, but I get your hyperbole), but you seem to be working under the assumption that LLMs are not going to improve beyond what they are now. It is still very much in its infancy, and as the tech matures this will be less and less until it only requires few people to manage LLMs that solve the tasks of a much larger work force.
It's hard to improve when the data in is human and the data out cannot be error checked back against its own data in. It's like trying to solve a math problem with two calculators that both think 2+2 = 6 because the data they were given said that it's true.
How is it hyperbole? All artificial neural networks have "hallucinations", no matter their size. What's your magic way of knowing when that happens?
LLMs now are trained on data generated by other LLMs. If you look at the "writing prompt" stuff 90% is machine generated (or so bad that I assume it's machine generated) and that's the data that is being bought right now.