AI & models
Token
A chunk of text — very roughly three-quarters of a word. AI models don't read letters or whole words; they read tokens. The word
unbelievable might be three tokens: un, believ, able. Why it matters
Part of Context and the context window → Almost everything is measured in tokens: how much an AI can read at once, how fast it replies, and what it costs. The context window is just a token budget.
see also