Model · Alibaba Qwen

Qwen3 0.6B

0.6B · Q8_0 · 0.6 GB · open weights · curated for general · repo created 2025-04-27

Runs easily on a 10 GB card at 32K context. Needs 5.7 GB. On an 8 GB card it runs at 8K and at 32K.

What the model needs: weights, context cache and runtime overhead at four reference contexts. The total is the model's own; what differs per machine is the usable memory it has to fit into — VRAM on a graphics card, unified memory on a Mac.

Cache shape from the model's config: 28 of 28 layers cache the full context, each storing K and V for 8 KV heads × 128 dimensions per token at f16. Multiply those four numbers by two bytes and by the context length and you have the cache column.

All memory figures are estimates: measured quantized file size + computed context memory + runtime overhead, with a 12% safety margin on your hardware. Real usage varies with runtime version and settings.

Every tracked GPU and Mac at 8K and 32K context with a full-precision (f16) cache — the same engine as the finder and the GPU pages.

Runs on 32 of 32 tracked devices at 8K context, easily or with ordinary headroom.

GGUF is the quantized single-file format local runtimes load (Ollama, LM Studio, llama.cpp); our memory figures are measured from the linked GGUF file. The original repo holds full-precision safetensors — a much larger download meant for GPUs with far more memory.

More from Alibaba Qwen

• Qwen3.8 Flash-Nextabout the same ◆
• Qwen3.8 27Babout the same ◆
• Qwen3.8 2.4T-A95Bmore popular ▲
• Qwen3 14Babout the same ◆
• Qwen3-Coder Nextmore popular ▲
• Qwen3-Coder 30B-A3Babout the same ◆

Every tracked model →