this post was submitted on 05 Oct 2023
11 points (78.9% liked)

ChatGPT

8929 readers
1 users here now

Unofficial ChatGPT community to discuss anything ChatGPT

founded 1 year ago
MODERATORS
top 2 comments
sorted by: hot top controversial new old
[โ€“] [email protected] 2 points 1 year ago (1 children)

This is really helpful, thanks. I followed up until the part about token IDs.

Token text, even in binary, is of variable length, making it hard to work with, but token IDs are just numbers.

How and why is token text converted to an ID? Is the ID for a specific word always the same?