--- title: "What Is a Token in AI? Definition and Examples" description: "What is a token in AI? A plain definition, how words and pages convert to tokens, why tokens set cost and limits, and how prices have moved." url: https://nexumautomations.com/glossary/llm-token updated: 2026-10-31 publisher: Nexum Automations, an AI consulting firm --- > Nexum Automations is an AI consulting firm that builds what it recommends. It finds where AI pays off in a company, builds it on the tools the team already uses and stays until it is live and working. Glossary # What is a token in AI? Explained A plain definition of an AI token, how text turns into tokens, why tokens drive usage cost and limits, and how prices have changed. Last reviewed October 30, 2026 Definition Token A token is the small piece of text a large language model reads and writes: a whole word, part of a word, a space or a punctuation mark. This is what a token in AI means: the unit the model counts instead of words. **In short:** The unit of text an AI model counts. Our data ## What buyers see in this search The first page of Google for "what is a token in ai", counted by type of result. | | Results | | ---------------------------------------------------- | ------------------------------- | | Articles by companies that sell a product or service | 6 of 8 | | Forums and Q&A threads | 1 of 8 | | Videos | 1 of 8 | | Titles that answer this exact search | 7 of 8 | | Google features on the page | An AI Overview, People also ask | The 8 organic results on the first page of Google, United States, desktop, measured with DataForSEO on October 29, 2026\. Types only: no company or product is named. Side by side ## Words to tokens, estimated Estimated from 1 token ~= 0.75 words. Formula: tokens = words / 0.75. | | Words | Estimated tokens | | ---------------- | ------------ | ------------------- | | A short sentence | 15 words | about 20 tokens | | A short email | 150 words | about 200 tokens | | A page of text | 500 words | about 670 tokens | | A long report | 3,000 words | about 4,000 tokens | | A short book | 30,000 words | about 40,000 tokens | ## What is a token in AI 1. Your text A sentence, email or document goes in. 2. Split A tokenizer cuts it into small pieces. 3. Tokens Each piece becomes one token. 4. Model The model reads and predicts the next token. When you send text to an AI model, it does not read words the way you do. The text is first split into small pieces, and each piece is a token. OpenAI describes tokens as the units its models use to process text. A short, common word is often one token. A long or rare word may be split into several. So what are tokens in AI in practice? They are the counting unit for everything the model takes in and puts out. Do not confuse them with other uses of the word. An LLM token is not a crypto token and not a login token. It only measures text for a language model. ## How many tokens in words and pages The OpenAI Help Center gives a rule of thumb: one token is about 4 characters, or 0.75 words, in English. It is an estimate, and real counts shift with the language and the wording. To estimate, divide your word count by 0.75\. The formula is: tokens = words / 0.75. Two things shift the count: other languages, and numbers or code, which often need more tokens per word. A standard tokenizer shows the exact count. ## Estimated token counts Use this table for quick planning. All figures are estimated from the rule of thumb above. ## Why tokens set cost and limits * Input Counted on what you send. * Output Counted on what comes back. * Price Quoted per million tokens. * Window The cap on tokens held at once. Providers meter usage in tokens. Input tokens (what you send) and output tokens (what the model writes back) are counted separately, and each side has its own price, usually quoted per million tokens. Tokens also set limits. Every model has a context window, the maximum number of tokens it can hold at once, covering your instructions, any documents you attach and its own reply. A long document plus a long answer can hit that ceiling. To budget, take your monthly volume in tokens and multiply by the rate your provider publishes. For wider budgeting, see our [AI development cost](https://nexumautomations.com/pricing/ai-development-cost) page. ## How token prices have moved Per-token costs keep falling. The Stanford AI Index 2025 reports that the cost of running a system at the level of GPT-3.5 dropped more than 280-fold between November 2022 and October 2024. The drop came largely from more capable small models. Even so, total spend can still rise when usage grows, since more tasks and longer documents mean more tokens. ## How a token differs from related terms Token * Piece of text the model counts * About 4 characters on average * Sets usage cost and limits Parameter * Learned value inside the model * Not a piece of your text * Describes model size, not usage A token is not the same as a word, a character or a model parameter. A word can be one token or several. A character is a single letter or symbol, and a token averages about 4 of them. A parameter is a learned value inside the model, not a piece of text. For the bigger picture, read about a [large language model](https://nexumautomations.com/glossary/large-language-model) and what [AI inference](https://nexumautomations.com/glossary/ai-inference) means when the model runs. FAQ ## Token questions * ### How many words are 1000 tokens? Using the OpenAI rule of thumb of 0.75 words per token, 1,000 tokens is about 750 words. The result is estimated and varies with language and wording. * ### What is a token in LLM systems? In a large language model, a token is the unit of text the model reads and writes, such as a word, part of a word or punctuation. Models process and generate text one token at a time. See [large language model](https://nexumautomations.com/glossary/large-language-model). * ### What is a token in ChatGPT? The same thing: a small piece of text. Chat tools count both your message and the reply in tokens, and the total must fit inside the model's context window. * ### Do AI tokens cost money? Through paid access, yes. Providers charge per token, quoted per million, with separate rates for input and output. Consumer chat plans often hide this behind a flat fee. * ### How much is 1000 tokens in AI? The price depends on the provider and model, so check the published rates. Multiply your token volume by that rate. Prices have fallen steeply: Stanford reports more than a 280-fold drop for GPT-3.5-level inference between late 2022 and late 2024. --- Source: https://nexumautomations.com/glossary/llm-token Free AI diagnosis (30-minute call): https://nexumautomations.com/#book - Services: https://nexumautomations.com/services - Guides: https://nexumautomations.com/guides