Hardware🖥️
NVIDIA RTX 3060 12GB
Released Dec 8, 2021
The most accessible consumer GPU with 12GB VRAM: the entry point for local inference. Comfortably runs 7-8B quantized models.
GPUNVIDIAInferenzaBudget
Tools, frameworks, and models for local AI
1 resource found for "Budget"
The most accessible consumer GPU with 12GB VRAM: the entry point for local inference. Comfortably runs 7-8B quantized models.