Skip to main content
โ† Back to glossary

Multi-Token Prediction (MTP)

Performance

A technique where the model is trained to predict multiple future tokens in a single step instead of one. It lets you propose several candidates without extra calls and underpins speculative decoding: the checkpoint ships the MTP modules already trained.

This term in other languages

๐Ÿ‡ฎ๐Ÿ‡นMulti-Token Prediction (MTP)
๐Ÿ‡ซ๐Ÿ‡ทMulti-Token Prediction (MTP)