Model Architecture

Encoder

The part of a model that reads and understands input.

Definition

In a transformer model, the encoder processes the input text and produces a rich internal representation of it — capturing meaning, context, and relationships between words. Encoder-only models (like BERT) are particularly good at tasks that require understanding existing text, such as classification and information retrieval. Models used for search and document understanding often rely heavily on encoder-style architectures.

Related Terms

Decoder

The part of a model that generates output.

Encoder-Decoder Model

A model with both encoder and decoder components — suited for translation and summarisation.

Transformer

The core architecture that powers most modern LLMs, introduced by Google in 2017.

Heard enough terminology — ready to talk outcomes?

We translate AI concepts into measurable business results. No upfront fees — you pay only when independently verified results are delivered.

← Back to glossary

Disclaimer

This definition is provided for educational and informational purposes only. It represents a general explanation of a technical concept and does not constitute professional, technical, or investment advice. Artificial intelligence is a rapidly evolving field; terminology, techniques, and capabilities change frequently. Coaley Peak Ltd makes no warranty as to the accuracy, completeness, or currency of the information provided. Nothing on this page should be relied upon as the sole basis for commercial, technical, legal, or investment decisions without independent professional advice.

Document reference: ISO_webpage_knowledge-base_glossary_v1

Last modified: 29 March 2026

Knowledge Base·Model Architecture·Encoder