Resources

Tools, frameworks, and models for local AI

All Organizations Hardware Software Models Inference Frameworks

Sort by:Name (A-Z)Name (Z-A)Category Newest first Oldest first Price (low to high)Price (high to low)VRAM (highest first)Parameters (largest first)

1 resource found for "Coding"

Inference⚡

SGLang

Released Jan 18, 2024v0.1.5

Open-source serving engine for LLMs with RadixAttention, continuous batching and first-class speculative decoding (MTP, EAGLE, draft models, ngram). Apache-2.0 license.

LLMServingGPUHigh-throughput

Learn more

CompareSite