Model Architecture

Decoder

The part of a model that generates output.

Definition

The decoder generates text one token at a time, using the internal representation built by the encoder (or, in decoder-only models, the processed input itself). Most modern large language models used for chat and generation are decoder-only — they take the input, build an internal understanding, and then generate a response sequentially. GPT-style models are decoder-only architectures.

Related Terms

Encoder

The part of a model that reads and understands input.

Autoregressive Model

A model that generates text one token at a time, each based on what came before.

Transformer

The core architecture that powers most modern LLMs, introduced by Google in 2017.

Heard enough terminology — ready to talk outcomes?

We translate AI concepts into measurable business results. No upfront fees — you pay only when independently verified results are delivered.

← Back to glossary

Disclaimer

This definition is provided for educational and informational purposes only. It represents a general explanation of a technical concept and does not constitute professional, technical, or investment advice. Artificial intelligence is a rapidly evolving field; terminology, techniques, and capabilities change frequently. Coaley Peak Ltd makes no warranty as to the accuracy, completeness, or currency of the information provided. Nothing on this page should be relied upon as the sole basis for commercial, technical, legal, or investment decisions without independent professional advice.

Document reference: ISO_webpage_knowledge-base_glossary_v1

Last modified: 29 March 2026

Knowledge Base·Model Architecture·Decoder