Skip to content

Topic

Local AI

Every ByteOrbital article about Local AI.

Thursday 12 November

17:40

Local AIAI-assisted

VRAM and large language models explained

How much memory a model really needs: weights, quantisation, the KV cache and overhead, with every figure computed by a script you can run.

17:40

Mini PCs

How to choose a mini PC for home AI

Unified memory or a discrete GPU? A buyer's framework built on memory capacity, bandwidth, power and noise, using published specifications.

17:40

Local AIAI-assisted

CPU vs GPU vs NPU for AI inference

Why memory bandwidth, not headline TOPS, sets how fast a local model talks, and where each kind of processor earns its place.

7 articles