this post was submitted on 08 Mar 2024
220 points (97.4% liked)
Memes
45535 readers
422 users here now
Rules:
- Be civil and nice.
- Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
And the problem is that since these dickwads want to close source their neural networks, we wasting billions of watts training on similar data sets repeatedly generating models with minor differences over and over again. If there was a truly awesome open source model, then we could train on top of it and create more complex and complex models targeted at the good of humankind. But no, stakeholders must get profits. When will they understand that the entire humanity is a stakeholder in this planet.
Good news is that open source approach appears to be advancing faster than closed models https://steve-yegge.medium.com/were-gonna-need-a-bigger-moat-478a8df6a0d2
That article is from 10 months ago.
Is open source catching up still? Or have the goalposts moved too much since then?
Open source models are still advancing quickly, pretty much everything the article mentions is still valid today.