Skip to content

Topic

GPU Memory

Every ByteOrbital article about GPU Memory.

Local AIAI-assisted

VRAM and large language models explained

How much memory a model really needs: weights, quantisation, the KV cache and overhead, with every figure computed by a script you can run.

7 min read

1 article