Tensor

A multidimensional array of numbers: the matrix that makes up each layer of a neural model (weights, biases, embeddings). In a GGUF file every tensor has a name, dimensions, type, and offset; it is the alignment and type of each tensor that determine how the model is loaded and how much memory it takes.