Skip to content

Microsoft

Phi-4 (14B)

14.7 B params · 16384 context · Open weights

Released 2024-12-11

Details

Provider
Microsoft
Family
Phi
Context length
16384 tokenssource
Open weights
Yessource
Licence
MITsource
Parameters (total)
14.66 Bsource

API pricing

No hosted API price verified. Open-weight models can be self-hosted.

Running it locally

Memory needed for 14.66 B parameters at 8,192 tokens of context. Architecture not recorded, so a flat 1.0 GB KV allowance is used. Estimates, not measurements.

FormatWeightsKV cacheOverheadTotal
Q4 K_M9.0 GB1.0 GB0.9 GB10.9 GB
Q6 K12.0 GB1.0 GB1.1 GB14.1 GB
Q8 015.6 GB1.0 GB1.3 GB17.9 GB
FP1629.3 GB1.0 GB2.0 GB32.3 GB

Catalogued hardware that fits at Q4

Mini PCs reserve 8.0 GB for the operating system. “Comfortable” keeps at least 10% memory spare.

Benchmarks

No benchmarks for this model yet

We only publish results we can evidence, so there is nothing here yet and we have not filled the gap with estimates. Here is how we will test and label results.