What is Token?
The small piece of text an AI model reads and writes — often part of a word. Prices and limits are counted in tokens. In English 1 token is about 4 characters; Korean, Japanese and Chinese usually use more tokens per character.
The small piece of text an AI model reads and writes — often part of a word. Prices and limits are counted in tokens. In English 1 token is about 4 characters; Korean, Japanese and Chinese usually use more tokens per character.