this post was submitted on 01 Apr 2024
189 points (98.0% liked)

Futurology

1770 readers
225 users here now

founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 30 points 7 months ago (4 children)

…and even AI-generated "synthetic data" as options.

HAHAHA

[–] [email protected] 9 points 7 months ago (2 children)

This is how the best chess and go computers got to be as good as they are. AI generated "synthetic data."

[–] [email protected] 18 points 7 months ago

Yes and no.

Chess bots (like Stockfish) are trained on game samples, with the goal of predicting what search path to keep looking at and which moves will result in a win. You get game samples by playing the game, so it made sense to have stockfish play itself, since the input was always still generated by the rules of chess.

If a classifier or predictive model creates it's own data without tying it to the rules and methods in reality, they're going to become increasingly divorced from reality. If I had to guess, that's what the guy in the article is referencing when talking about "sanitizing" the data. Some problems, like chess, are really easy. Mimicking human speech? Probably not

[–] [email protected] 5 points 7 months ago* (last edited 7 months ago)

Yeah, because the human developers know the rules of chess, so it's easy to generate or verify perfect quality games at massive scale. Natural language can't be tackled like that; certainly not yet, probably not ever. Many have tried and failed to parse natural language algorithmically, but at the end of the day it seems to rely heavily on loose conventions and endless shared experiences. So, you need content from the wild, or you're basically letting the AI mark its own homework.

[–] [email protected] 6 points 7 months ago* (last edited 7 months ago)

I work in AI. This is very common, and lots of companies use this. It's also very common in academia, as it's an easy way to get data. Synthetic data can range from totally fake to techniques like machine translation to transform data from one language to another.

When they say "AI generated", it's probably just using one of the API's the LLM orchestrates.

[–] [email protected] 5 points 7 months ago

The human centipede, but circular.

[–] [email protected] 1 points 7 months ago

Your laughter is misplaced. Synthetic data is a serious solution, and when it's done right it can give better results than raw "real" data alone.