Skip to main content

Blog

Articles, guides, and insights on local artificial intelligence

10 articles found per "api"

Ollama voice: local speech synthesis, from the command line to the OpenAI API
Use casesBeginner

Ollama voice: local speech synthesis, from the command line to the OpenAI API

Phonon brings speech synthesis to the Ollama server: one command to speak, an OpenAI-compatible endpoint and streaming read-aloud of the reply, 35% faster than the reference runtime on M5 Max.

iaLocale Team
November 17, 2026
SynthAPI: synthetic environments and scaling laws for training tool-use agents
Use casesAdvanced

SynthAPI: synthetic environments and scaling laws for training tool-use agents

Controlled synthetic environments with failures on a dial to train local tool-use agents: SynthAPI's scaling laws and the math — ~€1.60 of energy vs ~€158 of API for 10,000 tasks.

iaLocale Team
November 11, 2026
Secret Guard and local LLM gateways: protecting secrets while your agent uses them
Use casesIntermediate

Secret Guard and local LLM gateways: protecting secrets while your agent uses them

Secret Guard is a Rust, open-source gateway that intercepts your agent's requests and swaps secrets for mocks before they reach the provider: the model never sees them, and the real value comes back to the agent.

iaLocale Team
November 6, 2026
Local Images: ComfyUI 0.40 and comfy_attention — new for all models
Use casesIntermediate

Local Images: ComfyUI 0.40 and comfy_attention — new for all models

ComfyUI 0.40 extends comfy_attention to all models with per-model selectable kernels and LoRA override, turns on the asset system by default with a local API, and standardizes 3D output; the VRAM table stays the choice reference.

iaLocale Team
October 27, 2026
ML agents that run locally: MLExpert and EpochGo on Ollama, zero API costs
Use casesIntermediate

ML agents that run locally: MLExpert and EpochGo on Ollama, zero API costs

MLExpert raises the bar to 35B and a 72.7% medal rate; EpochGo runs three AutoML agents on 16 GB at zero API cost: what works today, the math and the limits.

iaLocale Team
October 26, 2026
Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup
GuidesAdvanced

Mac Studio M5 Ultra: practical 512GB guide - models that fit and GGUF setup

What actually fits in the 512GB Mac Studio M5 Ultra: the 4-bit rule for MoE (active vs total params), three GGUF setup paths (Ollama, LM Studio, llama.cpp), why the KV cache is the real bottleneck, and when the $9,999 pays back against APIs.

iaLocale Team
October 20, 2026
Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM
ModelsIntermediate

Ling 3.1 Flash: 560B open-weight with MIT license and 1M context — what changes if you have 24GB of VRAM

inclusionAI's Ling 3.1 Flash: hybrid MoE 560B total / 25B active, native 1M-token context, FP8 checkpoint, MIT license. What it concretely means for 24GB of VRAM: quantizations, parallelism and API costs.

iaLocale Team
October 19, 2026
What a token costs: five routes, the math, and the break-even point
ComparisonsIntermediate

What a token costs: five routes, the math, and the break-even point

Frontier API, subscription, inference providers, rented GPU or your own hardware: five routes to tokens, with real monthly costs, the electricity bill, and the calculated break-even point.

iaLocale Team
October 15, 2026
Costs: local vs API, done with real numbers
Use casesIntermediate

Costs: local vs API, done with real numbers

How much does local really cost compared to a cloud API? Verified per-token prices, GPU amortization, electricity and the break-even point, calculated with real numbers.

iaLocale Team
October 6, 2026
Ollama vs LM Studio: Which Tool to Choose
ComparisonsIntermediate

Ollama vs LM Studio: Which Tool to Choose

Ollama for servers and scripts, LM Studio for desktop exploration: the comparison table, the two APIs (11434/1234) and the real case of using both.

iaLocale Team
June 9, 2026