Open WebUI v0.11.4: per-file metadata and faster hybrid search on large knowledge bases
Use casesRelated articles
RAG: ask questions to your own documents
RAG (Retrieval Augmented Generation) is the simplest way to make a local model answer questions about your own documents: embeddings, vector database and retrieval loop, with a concrete example.
Local AI for your business: 5 practical use cases
Five concrete scenarios where local AI brings immediate value to a business: customer support on your own documents, data extraction from PDFs, internal search, CRM and content generation — with the tools to use and the hardware needed.
KV cache: why your RAM needs more than just the model
What the KV cache is, the formula to calculate it with real numbers from Llama 3.1 8B and Qwen3 8B, and the three levers to manage it: context, quantization and flash attention.
Get the next local-AI briefing
Once a week, the top selection from iaLocale: articles, news and resources on local AI, and more.
After signing up you receive a confirmation email (double opt-in). Without confirmation we send nothing. No spam, we promise.