Skip to main content
← Back to glossary

Transformer

Architectures

Neural network architecture introduced in 2017 (Attention Is All You Need) that revolutionized NLP. Unlike recurrent networks, Transformers use attention to process the entire input simultaneously. All modern LLMs (GPT, Llama, Mistral, Claude) are based on this architecture.

Related articles

This term in other languages

🇮🇹Transformer
🇫🇷Transformer