Tools, frameworks, and models for local AI
5 resources found for "Hardware"
The cloud platforms for models: alternatives when local hardware isn't enough. Replicate and Runpod in the catalog are the child resources.
Open-source inference engine (Rust, YC S25) that compiles and tunes its kernels directly on the target hardware: Apple Silicon, NVIDIA, AMD or CPU. On open models it claims up to 2× the speed of llama.cpp. Also aimed at serving agents.
Serverless platform for running code and AI models on GPUs: you pay for real seconds of use, it scales to zero when idle, and you can run any open-weights model. One of the routes to inference on rented hardware without managing servers.
A marketplace for renting GPUs: GPU owners put their capacity up for sale and rent it out by the hour or by period, at prices that follow demand. A middle path between frontier cloud and your own hardware.
High-throughput LLM serving with PagedAttention and hardware optimizations.
