byob: the Rust desktop AI agent, no Electron, for the models you already run locally
Tools & releasesRelated articles
vLLM: serving models fast
vLLM is the open-source engine that turns a local model into a concurrent server: PagedAttention, continuous batching, installation and the concepts (throughput, quantization, KV cache) for choosing when to use it instead of Ollama.
Qwen: the open model with the best multilingual support
Qwen is the open family with the best support for Italian and French: generations, sizes, MoE, when to use it, and a quick comparison with Llama.
Ollama voice: local speech synthesis, from the command line to the OpenAI API
Phonon brings speech synthesis to the Ollama server: one command to speak, an OpenAI-compatible endpoint and streaming read-aloud of the reply, 35% faster than the reference runtime on M5 Max.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.

