this post was submitted on 23 Dec 2024
12 points (100.0% liked)
TechTakes
1490 readers
34 users here now
Big brain tech dude got yet another clueless take over at HackerNews etc? Here's the place to vent. Orange site, VC foolishness, all welcome.
This is not debate club. Unless it’s amusing debate.
For actually-good tech, you want our NotAwfulTech community
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It is also lovely that the quote follows directly after Google's glue in pizza. Just pivot to something else.
But since I don't trust the linked AI fondler's description, what is RAG? Sounds like an LLM stapled to a search engine.
Rag feels to me like the other new llm tricks (like voice commands), the base model cant be improved much so they tack on modules which make it look like the base tech is still improving. While in reality it is just the tacking on of older tech.
If it were merely a search engine, it risks not being ai enough. We already have search engines, and no one is gonna invest in that old garbage. So instead, it finds something that you might want that’s been predigested for ease of ai consumption (Retrieval), dumps it into the context window alongside your original question (Augmentation) and then bullshits about it (Generation).
Think of it as exactly the same stuff that the LLM folk have already tried to sell you, trying to work around limitations of training and data availability by providing “cut and paste as a service” to generate ever more complex prompts for you, in the hopes that this time you’ll pay more for it than it costs to run.