Multi-Token Prediction (MTP)
PerformanceA technique where the model is trained to predict multiple future tokens in a single step instead of one. It lets you propose several candidates without extra calls and underpins speculative decoding: the checkpoint ships the MTP modules already trained.
This term in other languages
๐ฎ๐นMulti-Token Prediction (MTP)
๐ซ๐ทMulti-Token Prediction (MTP)

