Skip to main content
← Back to glossary

RAM (system memory)

Hardware

The computer's main memory, used by the CPU for programs and — without a GPU — for loading model weights. In CPU inference, the amount of RAM determines which models you can load and its bandwidth determines the generation speed.

This term in other languages