this post was submitted on 16 Jan 2025
273 points (93.6% liked)
memes
10970 readers
3736 users here now
Community rules
1. Be civil
No trolling, bigotry or other insulting / annoying behaviour
2. No politics
This is non-politics community. For political memes please go to [email protected]
3. No recent reposts
Check for reposts when posting a meme, you can only repost after 1 month
4. No bots
No bots without the express approval of the mods or the admins
5. No Spam/Ads
No advertisements or spam. This is an instance rule and the only way to live.
Sister communities
- [email protected] : Star Trek memes, chat and shitposts
- [email protected] : Lemmy Shitposts, anything and everything goes.
- [email protected] : Linux themed memes
- [email protected] : for those who love comic stories.
founded 2 years ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
I know it's a meme, but the idea that transformers models 'remember' anything is a common misconception.
They have zero memory. When you submit a prompt, it feeds your entire chat history as one big prompt and... forgets it immediately, with no impact on the model itself. It's like its frozen in time, and copied, unfrozen, and thrown away every time it answers.
Yeah, yeah, let's see how Google will achieve more memory with their new Titan architecture
It's still ephemeral, chats don't change the underlying language model, but yes it's interesting.