Model Architecture
Autoregressive Model
A model that generates text one token at a time, each based on what came before.
Definition
An autoregressive model generates its output step by step — each new token is predicted based on everything that came before it. This is why, if you watch a language model type, it appears to think in real time: it is literally deciding one word (or part of a word) at a time. This sequential generation is what gives LLM responses their coherent, flowing quality. The trade-off is speed — longer responses take longer to generate.
Related Terms
Heard enough terminology — ready to talk outcomes?
We translate AI concepts into measurable business results. No upfront fees — you pay only when independently verified results are delivered.
Disclaimer
This definition is provided for educational and informational purposes only. It represents a general explanation of a technical concept and does not constitute professional, technical, or investment advice. Artificial intelligence is a rapidly evolving field; terminology, techniques, and capabilities change frequently. Coaley Peak Ltd makes no warranty as to the accuracy, completeness, or currency of the information provided. Nothing on this page should be relied upon as the sole basis for commercial, technical, legal, or investment decisions without independent professional advice.
Document reference: ISO_webpage_knowledge-base_glossary_v1
Last modified: 29 March 2026
Knowledge Base·Model Architecture·Autoregressive Model