Tools, frameworks, and models for local AI
2 resources found for "Ollama"
Bespoke Labs' 9B decision model: it runs entirely locally via Ollama 0.35 and answers typed questions (true/false, numeric scale, multiple choice) through the new systemone API. Built for fast classification in automated pipelines, no cloud.
The first open-source MoE of OpenBMB's MiniCPM-V series: 35.2B total parameters, ~3B active per token, multi-image and video understanding with early visual-token compression (LLaVA-UHD v4). First open-source MoE with fluid on-device decoding — 13+ tok/s on 3GB of RAM on an iPhone 17 Pro Max — thanks to Lookahead Expert Scheduling (llama.cpp-omni), fine per-level quantization and DSpark speculative sampling. Day-0 support for Rockchip, Houmo, Intel, AMD and Arm; runs on Ollama, llama.cpp, vLLM and SGLang.
