this post was submitted on 28 Jan 2024
1042 points (97.6% liked)
Programmer Humor
19450 readers
268 users here now
Welcome to Programmer Humor!
This is a place where you can post jokes, memes, humor, etc. related to programming!
For sharing awful code theres also Programming Horror.
Rules
- Keep content in english
- No advertisements
- Posts must be related to programming or programmer topics
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It literally cannot come up with novel solutions because it's goal is to regurgitate the most likely response to a question based on training data from the internet. Considering that the internet is often trash and getting trashier, I think LLMs will only get worse over time.
AI has poisoned the well it was fed from. The only solution to get a good AI moving forward is to train it using curated data. That is going to be a lot of work.
On the other hand, this might be a business opportunity. Selling curated data to companies that want to make AIs.
I could see large companies paying to train the LLM on their own IP even just to maintain some level of consistency, but it obviously wouldn't be as valuable as hiring the talent that sets the bar and generates patent-worthy inventions.
You can fine tune a model with specific stuff today. OpenAI offers that right on their website and big companies are already taking advantage. It doesn't take a whole new LLM, and the cost is a pittance in comparison.
I said this a while ago but you know how we have "pre-atomic" steel? We are going to have pre-LLM data sets.
Very interesting, today I learned.
The reason why chat gpt 3.5 is still great for anything previous to it's cutoff date. It's not constantly being updated with new garbage
Also the more the internet is swept with AI generated content, the more future datasets will be trained on old AI output rather than on new human input.
Humans are also now incentivized to safeguard their intellectual property from AI to keep a competitive advantage.
What are some strategies for doing that? (This is me, totally not a bot)
Paywalls.
Lets see, since the goal is to prevent webscaping all these should work: paywalls, account only acsess, text obferscation (e.g. using a custom font that maps letters randomly to other ones so it looks fine but to a webscraper it looks like gibberish), HTML obferscation (inserting random characters in the HTML then hiding them using CSS) and many more.
Hi, I don't want to say too much, but after being invited to some closed AI talks by one of the biggest chip machine manufacturers (if you know the name, you know they don't mess around), I can tell you AI is, in certain regards, a very powerful tool that will shape some, if not all, industries by proxy. They described it as the "internet" in the way that it will take influence on everybody's life sooner or later, and you can either keep your finger on the pulse or get left behind. But they distinguished between the "AI" that's floating around in the public sector vs. actual purpose-trained AI that's not meant for public usage. Sidenote: They are also convinced the average user of a LLM is using it the "wrong" way. LLMs are only a starting point.
Also, it's concerning; I'm pretty sure the big boys have already taken over the AI market, so I do not trust that it will be to the benefit of all of us and not only for a select group (of shareholders) that will reap the benefits.
Yeah you definitely went to a marketing thing and got marketed to
Like when they claim your smart thermostat is now "AI powered" despite the fact it's the same exact product it was 2 years ago
Again, none of the people at this talk have anything to do with selling a product or pushing an agenda or whatever you think. There is no press, there is no marketing, there is no product - it was basically a meetup of private equity firms that discussed the implementation and impact of purpose-trained AI in diverse fields, which affects the business structure of the big single-family office behemoths, like an industry summit for the private equity sector regarding the future of AI and how some plan to implement it (mainly big non-public SFOs).
Sometimes people just meet to discuss strategy; no one at these talks is interested in selling you anything or buying anything - they are essentially top management and/or members of large single-family offices and other private equity firms. They are not interested in selling or marketing something to the public; they are not public companies.
It's weird how you guys react; not everything is a conspiracy or a marketing thing. It's pretty normal in private equity to have these closed talks about global phenomena and how to deal with it.
These talks are more to keep the industry informed. I get that you do not like it when essentially the big SFOs have a meeting where they discuss their future plans on a certain topic, but it's pretty normal that the elite will arrange themselves to coordinate some investments. It's essentially just the offices of the big billionaire families coming together to put heads together to discuss a topic that might influence their business structure. But, in no way is it a marketing strategy; it would, on the contrary, be negatively viewed in the public eye that big finance is already coordinating to implement AI into their strategy.
But feelings don't change facts. My point is if the actual non public big players are looking at AI in a serious matter, then so should you.
Its not a conspiracy... You are obviously not involved in the actual ML/AI, but another sector. You aren't speaking in any technical explaination.
A lot of us are involved in the technical aspect and understand what is being said by management.
I never argued that I was in IT/Tech; I deal with investments and PE. I have nothing to do with IT or tech. My point is we, in the PE/FO sector, are going to invest in AI businesses in 24/25, not only in the "B2C market" but mainly in the B2B market and for internal applications. Whether you believe it or not, it's gonna happen anyway.
Oh gosh I'm so afraid of the anonymous business daddy that told you AI is sexy.
So Nvidia (or Intel or AMD) told you that you need to AI to stay competitive. Not only that, but you needed a bespoke solution. Not the toy version out on the net every can get access to.
Strangely enough, they have some wonderful products coming to market which would be just what you need to build a large training network capable of injesting all your company data. They'd be happy to help you on this project.
All they had to do to get you to drop your guard was invite you by name to a "closed talk".
Haha, lol, whats happening why do you hate me, just sharing an experience, an opinion?
I have already said too much - just let me tell you if you think LLMs are the pinnacle of AI, you are very mistaken, and depending on your position in the market, you need to take AI into account. You can only dismiss AI if you have a position/job with no real responsibility.
So weird how you guys think everything is to sell you something or a conspiracy - this was a closed talk to discuss how the leaders in certain industries will adapt to the coming changes. They give zero cares about the B2C market, aka you as an individual.
Again, none of the people at this talk have anything to do with selling a product or pushing an agenda or whatever you think. There is no press, there is no marketing - it was basically a meetup of private equity firms that discussed the implementation and impact of purpose-trained AI in diverse fields, which affects the business structure of the big single-family office behemoths.
As long as AI isn't outlawed or "regulated" in some stupid way, open-source AI models will stay competitive. People are interested in AIs and working on them is exciting and doesn't require a lot of code or other bullshit, this is the type of thing that the open-source community will work on.