Inference🔗
Replicate
Released Jun 1, 2022by Inferenza cloud
API platform to run ML models without managing infrastructure.
APICloudMLServerless
Back to resources
Inference☁️
Inferenza cloud
The cloud platforms for models: alternatives when local hardware isn't enough. Replicate and Runpod in the catalog are the child resources.
Features
- On-demand GPU without hardware purchase
- Billing per second or per generated image
- Cold start: a few seconds to boot
Resources by Inferenza cloud
Inference☁️
RunPod Serverless
Released Mar 1, 2023by Inferenza cloud
Serverless platform for deploying and auto-scaling AI models with GPUs.
ServerlessCloudGPUDeployment
Tags
Discover Inferenza cloud
Visit the official site to download, learn more and start using Inferenza cloud.
Related resources — Inference
Inference⚡
llama.cpp
Released Oct 15, 2022
C++ implementation of LLMs for efficient inference on consumer CPUs and GPUs.
LLMC++LocalEfficient
Inference🦙
Ollama
Released Jul 27, 2023v0.35.0
Open source tool to run LLMs locally with simplicity.
LLMLocalOpen SourceCLI
Inference🗣️
Piper TTS
Released Apr 1, 2022Piper
Sintesi vocale in locale a bassa latenza basata su ONNX: genera parlato naturale da testo in tempo quasi reale, anche su CPU. Multilingue (italiano incluso) e facile da integrare nei pipeline: download del modello, una riga di comando. MIT.
AudioTTSOpen SourceLocale