Local AI Glossary

Terms and definitions of local artificial intelligence, open source models, and computing.

Sort terms by:Name (A-Z)Name (Z-A)Category

All categories Training Architectures Use cases Concepts Formats Hardware Model types Generative models Optimization Performance Serving Security Tools Techniques Technologies tecnologie

4 terms in Tools

Hugging FaceTools

The leading open-source platform for AI models, datasets, and applications. The Hugging Face Hub hosts thousands of open-source LLM models (Llama, Mistral, Phi, and many others) ready for download and local use. It is also an organization that develops libraries such as Transformers and Datasets.

llama.cppTools

Library written in C++ to run LLM models on consumer CPUs and GPUs. It is the underlying engine for many local inference tools, including Ollama. It supports GGUF quantization and can run large models on limited hardware by leveraging both CPU and GPU.

MLXTools

Apple's machine learning framework designed for Apple Silicon chips. It powers many local AI applications on Mac, leveraging unified memory to accelerate inference.

OllamaTools

Open-source tool to download, manage, and run LLM models locally. Supports Llama, Mistral, Phi, and many more. With a single command, you can start a model and access it via a local REST API. It is one of the easiest ways to get started with local AI.