Skip to main content
← Back to news

llama.cpp b11716: Q1_0 and Q2_0 support on the Snapdragon NPU (Hexagon) backend

Tools & releases
Source:GitHub
Build b11716 adds Q1_0 and Q2_0 Quantization support to the Hexagon backend (Snapdragon NPU), extending mobile NPU Inference to the most aggressive quantizations. Pre-release, October 17.
Read original article

Related articles

Llama 3 and Llama 4: Meta's open family — which model runs on your hardware

From the 3.1 8B to the 4 Scout MoE with a 10M context: the Llama family in a table, what runs on 16, 48 and 128 GB of RAM, the Community license translated for the Italian business and the choice by budget.

KV cache: why your RAM needs more than just the model

What the KV cache is, the formula to calculate it with real numbers from Llama 3.1 8B and Qwen3 8B, and the three levers to manage it: context, quantization and flash attention.

Qwen: the open model with the best multilingual support

Qwen is the open family with the best support for Italian and French: generations, sizes, MoE, when to use it, and a quick comparison with Llama.

Get the next local-AI briefing

Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.

After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

Related resources

Tools and resources from the iaLocale archive relevant to this content.

🦙

Llama 3.1 405B

Models

Meta's largest open model: closed-frontier quality but datacenter requirements. In practice it needs high-VRAM multi-GPU or the cloud.

🦙

Llama 3.1 70B

Models

Frontier-class open model with 131K-token context. Needs 48-80GB VRAM, a Mac with unified memory, or a multi-GPU setup.

🦙

Llama 3.1 8B

Models

The de-facto local workhorse: solid quality, 131K-token context and a huge GGUF quantization ecosystem. The standard choice for chat and assistants.

🦙

Llama 3.2 1B

Models

Small, fast model with up to 131K-token context. Ideal entry point for chat and summarization on modest hardware, great on phones and mini-PCs.

Browse all resources