Inference☁️
RunPod Serverless
Released Mar 1, 2023
Serverless platform for deploying and auto-scaling AI models with GPUs.
ServerlessCloudGPUDeployment
Back to resources
Replicate
Released on Jun 1, 2022
API platform to run ML models without managing infrastructure.
Features
- No infrastructure
- Pay-per-run
- Model library
- Webhooks
Tags
Useful links
Discover Replicate
Visit the official site to download, learn more and start using Replicate.
Related resources — Inference
Inference🟠
Anthropic Claude
Released Mar 14, 2023
Inference API for Anthropic's Claude models (Claude 1 since 2023). Like OpenAI, you pay per token, input and output, with request limits per plan: the frontier path with no servers of your own.
APIFrontierPaga-al-tokenCloud
Inference⚡
faster-whisper
Released Feb 11, 2023v1.2.1
Reimplementation of Whisper based on CTranslate2: up to 4 times faster than openai/whisper with the same accuracy and less memory. Supports 8-bit quantization on both CPU and GPU.
AudioTrascrizioneOpen SourceLocale