this post was submitted on 04 Aug 2023
35 points (100.0% liked)
Technology
37691 readers
348 users here now
A nice place to discuss rumors, happenings, innovations, and challenges in the technology sphere. We also welcome discussions on the intersections of technology and society. If it’s technological news or discussion of technology, it probably belongs here.
Remember the overriding ethos on Beehaw: Be(e) Nice. Each user you encounter here is a person, and should be treated with kindness (even if they’re wrong, or use a Linux distro you don’t like). Personal attacks will not be tolerated.
Subcommunities on Beehaw:
This community's icon was made by Aaron Schneider, under the CC-BY-NC-SA 4.0 license.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I'm loving that business people are starting to see what modern day AI actually is. Us in the tech industry have known it ever since a first came out, very interesting technology with some real promise and applications, but not true AI. The article is right, it cannot create anything, it can't generate new concepts, by definition everything is derivative of previous work.
They're definitely some areas of business that can really benefit from this, but there's also a lot of limitations of it as well. It's ending up not being the perfect solution to end all labor that everyone assumed.
But worries me is in the future when we do have actual intelligent AI that can think, this just shows how business will immediately react to it. An excuse to finally get rid of all of us workers so they can buy their 18th yacht
What is the difference between creating something “truly new” and creating a “derivative work”?
Are you saying that anything that fulfills the same statistical interrelationships as the training set, is therefore a derivative of the training set?
Like if I asked the thing “What happens when I place a basketball on a table then lift one side of the table?” its answer is some derivative of other scenarios involving tilting tables with basketballs on them?
Or is it using knowledge of how “round” works, that “round” things “roll”, that “rolling” tends to go “downward”, that things reaching the edge of a platform then “fall”, etc?
These are statistically inferred relationships between words, but at a certain point recombining elements into new compositions is creation and not derivative work.
It’s like saying that Chopin made derivative work based on Beethoven because he heard Beethoven’s music and learned about beautiful note patterns from it.
Yes yes yes I get that, but it cannot create some brand new concept. It can make an amalgamation of things it can see, it can predict things, but only on ideas that have happened before, because something somewhere along the line it was trained on. I know what you're saying, but it doesn't have creative spark, it doesn't have imagination, it doesn't have life... yet.
It does a great job at creating derivative work, you can even ask it to create a new style - but that style will by definition be somehow derived from something it was trained on. Until it can think and beyond that - have imagination, then it's limited. In short, we need Data, not just data.
What’s an example of a person inventing a new concept, that an LLM can’t do?
Okay you're really just trying to pick an argument and I'm not going down that path. Everyone who works on llms knows the limitations. Llms can't think, they can't create, only give a probability on how close things are to what's requested. I know what you're trying to say. It's not accurate. Humans can truly think, they have consciousness, they learn. At this point llms cannot truly learn. This is all I'm going to say about it.
The academic name for the field is quite literally "machine learning".
You are incorrect that these systems are unable to create/be creative, you are correct that creativity != consciousness (which is an extremely poorly defined concept to begin with ...) and you are partially correct about how the underlying statistical models work. What you're missing is that by defining a probabilistic model to objects you can "think"/"be creative" because these models dont need to see a "blue hexagonal strawberry" in order to think about what that may mean and imagine what it looks like.
I would recommend this paper for further reading into the topic and would like to point out you are again correct that existing AI systems are far from human levels on the proposed challenges, but inarguably able to "think", "learn" and "creatively" solve those proposed problems.
The person you're responding to isn't trying to pick a fight they're trying to help show you that you have bought whole cloth into a logical fallacy and are being extremely defensive about it to your own detriment.
That's nothing to be embarrassed about, the "LLMs can't be creative because nothing is original, so everything is a derivative work" is a dedicated propaganda effort to further expand copyright and capital consolidation.
Then that puts me at a disadvantage because I don’t know what you’re trying to say.
It’s good at automating basic things, it can really help be a tool but it’s extremely lacking and while it will lead us to new places, I think it will go hand in hand with how we regulate and evolve alongside it.