llama.cpp v0.9.0: OCP FP8 quantization, unified KV for multi-sequence and Chatterbox TTS
Tools & releasesRelated articles
Mistral Large 4 in open weights: a 1T MoE (52B active) for on-premise inference
One trillion parameters, 52B active, 1M context, open-weight license: the quant, RAM and speed math for running it on-premise.
KV cache: why your RAM needs more than just the model
What the KV cache is, the formula to calculate it with real numbers from Llama 3.1 8B and Qwen3 8B, and the three levers to manage it: context, quantization and flash attention.
MagpieTTS 357M: 12-language speech synthesis that runs on a laptop
NVIDIA's MagpieTTS Multilingual 357M: 12 languages, Italian included, in a 332 MB file that runs locally on a laptop without a GPU. Requirements, a three-command setup, and the honest limits.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

