Model Architecture
Vocabulary
The complete set of tokens a model knows and can use.
Definition
A model's vocabulary is the fixed set of tokens it was trained to recognise and produce. Tokens outside this vocabulary — unusual proper nouns, specialised technical terms, non-Latin scripts — may be broken into multiple tokens or represented less accurately. Most large models have vocabularies of tens of thousands of tokens, which allows them to handle a wide range of language fluently.
Related Terms
Token
The basic unit an LLM reads and writes — roughly equivalent to a word or part of a word.
Tokenisation
The process of breaking text into tokens before the model processes it.
Large Language Model (LLM)
A type of AI trained on vast amounts of text that can read, write, summarise, and reason with language.
Heard enough terminology — ready to talk outcomes?
We translate AI concepts into measurable business results. No upfront fees — you pay only when independently verified results are delivered.
Disclaimer
This definition is provided for educational and informational purposes only. It represents a general explanation of a technical concept and does not constitute professional, technical, or investment advice. Artificial intelligence is a rapidly evolving field; terminology, techniques, and capabilities change frequently. Coaley Peak Ltd makes no warranty as to the accuracy, completeness, or currency of the information provided. Nothing on this page should be relied upon as the sole basis for commercial, technical, legal, or investment decisions without independent professional advice.
Document reference: ISO_webpage_knowledge-base_glossary_v1
Last modified: 29 March 2026
Knowledge Base·Model Architecture·Vocabulary