Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

13 articles found per "locale"

Nemotron-Parse: NVIDIA's OCR family for reading documents locally
ModelsBeginner

Nemotron-Parse: NVIDIA's OCR family for reading documents locally

Nemotron Parse is NVIDIA's vision encoder-decoder family that reads PDFs locally: formatted markdown, LaTeX formulas, coordinates and a semantic class for every element, in reading order. v1.1 (Nov 2025), v1.2 (Feb 2026) and 2.0 (Jun 2026), all under 1 billion parameters and re-released on October 20; 2.0 reaches 0.72 ANLS on Indic scripts. Locally with vLLM v0.20 through v0.26: your documents stay on your hardware.

iaLocale Team
October 24, 2026
MagpieTTS 357M: 12-language speech synthesis that runs on a laptop
Use casesBeginner

MagpieTTS 357M: 12-language speech synthesis that runs on a laptop

NVIDIA releases MagpieTTS Multilingual, 364M parameters and 12 languages in one model: local text-to-speech with a 332 MB GGUF file, no GPU. The C++ runtime NeMo-Speech.cpp takes you from zero to first audio in three commands; the five voices are the same in every language, and for a natively Italian voice Piper is still ahead.

iaLocale Team
October 22, 2026
Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
GuidesAdvanced

Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup

What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.

iaLocale Team
October 20, 2026
Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM
ModelsIntermediate

Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM

inclusionAI's Ling 3.1 Flash: hybrid MoE 560B total / 25B active, native 1M-token context, FP8 checkpoint, MIT license. What it concretely means for 24GB of VRAM: quantizations, parallelism and API costs.

iaLocale Team
October 19, 2026
Aleph Alpha's Kolibri: the 78B MoE that runs (almost) locally
ModelsIntermediate

Aleph Alpha's Kolibri: the 78B MoE that runs (almost) locally

Aleph Alpha's Kolibri (78.1B/3.46B, Apache 2.0, FP8) is the European open-weight MoE: reasoning, tool calling and context up to 1M tokens. In FP8 it weighs ~78GB of VRAM: it runs on an RTX 5090 32GB + shared RAM or on unified-memory Macs; for practical adoption the kolibri1 architecture in llama.cpp and Ollama/LM Studio builds are still missing.

iaLocale Team
October 18, 2026
NVIDIA, AMD and Intel for local AI: which platform to choose
ComparisonsIntermediate

NVIDIA, AMD and Intel for local AI: which platform to choose

CUDA, ROCm or Vulkan? We compare the three local-AI platforms based on what is actually available: official software stacks, cards by VRAM tier (12, 16 and 24GB) and real speeds. Where the obvious choice remains, where AMD wins on value, and when it makes sense to leave NVIDIA.

iaLocale Team
October 14, 2026
The 16GB Blackwell cards: 5060 Ti, 5070, 5070 Ti
HardwareIntermediate

The 16GB Blackwell cards: 5060 Ti, 5070, 5070 Ti

The 16GB VRAM tier is the center of gravity of local AI in 2026. It's enough memory to run the best open dense models in Q4 formats — the 27B class, the new balance point of the open catalog — without giving up too much context, and a list price that (depending on the month) stays within a personal budget. The Blackwell generation offers three cards exactly in the middle of this tier: the RTX 5060 Ti, 5070 and 5070 Ti. Same generation, same GDDR7, three very different experiences. Here's how they compare: what each one really brings you, and where your budget should go.

iaLocale Team
October 13, 2026
Unified memory: from Strix Halo to Mac Studio M5 Ultra — what fits and at what speed
HardwareIntermediate

Unified memory: from Strix Halo to Mac Studio M5 Ultra — what fits and at what speed

128GB or 512GB of memory shared between CPU and GPU: three real platforms, the bandwidth that determines speed, and the math on what fits and for whom it makes sense.

iaLocale Team
October 10, 2026
Ollama vs llama.cpp: under the hood
ComparisonsIntermediate

Ollama vs llama.cpp: under the hood

Ollama runs llama.cpp under the hood, but the two are not the same thing: one is the engine, the other the car. What's really underneath, when the difference matters, and how to choose without slogans.

iaLocale Team
October 7, 2026
Costs: local vs API, done with real numbers
Use casesIntermediate

Costs: local vs API, done with real numbers

How much does local really cost compared to a cloud API? Verified per-token prices, GPU amortization, electricity and the break-even point, calculated with real numbers.

iaLocale Team
October 6, 2026
Local voice: from Whisper to text-to-speech
GuidesIntermediate

Local voice: from Whisper to text-to-speech

How to build a fully local voice pipeline: transcription with Whisper, synthesis with Piper or Kokoro-82M, hardware requirements, and practical use cases.

iaLocale Team
October 5, 2026
A Model Without a GPU: When the CPU Is Actually Enough
HardwareIntermediate

A Model Without a GPU: When the CPU Is Actually Enough

In 2026, CPU-only inference is no longer a fallback: when it genuinely works, what speed to expect, and which levers to pull to squeeze the most out of your processor.

iaLocale Team
October 2, 2026
What is local AI and why you need it
FundamentalsBeginner

What is local AI and why you need it

A practical explanation of local AI: running a model on your own hardware instead of the cloud. Differences from cloud AI, the concrete benefits (availability, privacy, predictable cost, full control), honest limits, and a five-minute start with Ollama.

iaLocale Team
September 8, 2026