this post was submitted on 13 Jun 2024
505 points (95.0% liked)
Memes
45661 readers
1332 users here now
Rules:
- Be civil and nice.
- Try not to excessively repost, as a rule of thumb, wait at least 2 months to do it if you have to.
founded 5 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Transformers are not built with our knowledge of language. That's a gross approximation -- it would honestly be more accurate to say they're modelled after the human brain than that they're built with our understanding of language. A big problem is that the connection between AI and language is poorly understood -- we can't even understand what the word2vec axes are.
i'm not talking about knowing about how humans perceive/learn languages, i'm talking about language structure. Perhaps it's wrong to call it "how languages work"
That's what I meant, yes. They're not built based on any linguistic field