Skip to content

Topic

VRAM

Every ByteOrbital article about VRAM.

Local AIAI-assisted

VRAM and large language models explained

How much memory a model really needs: weights, quantisation, the KV cache and overhead, with every figure computed by a script you can run.

7 min read

1 article