Skip to content
AI Compute Radar
IndexCollected 2 h ago

Gate: the smallest device with an EXCELLENT fit at 32K context. Seat: the measured GGUF file.

Pick of the week — Week 43, 2026 · selected by rule, written by people

An eighteen-month-old 8B climbs the trending list

Qwen3 8B by Alibaba Qwen takes the seventh pick: Heat Score 45 to 65 in seven days, the largest gain among models that run comfortably on a 24 GB card and are not on cooldown. Its Q4_K_M file measures 4.7 GB; at 8K context it needs 6.8 GB, EXCELLENT on every 12 GB card we track. At 32K it needs 10.9 GB, and 4.5 GB of that is context cache — the mirror image of last week's pick.

Measured signals as of 2026-10-23 18:15 UTC · Hugging Face + Vast.ai · method on /methodology

Where it runs

Fit engine · measured GGUF + computed KV cache · usable memory after margins
Device8K context32K context
RTX 30708 GB · usable 7 GBTIGHT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 40608 GB · usable 7 GBTIGHT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 50608 GB · usable 7 GBTIGHT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 3060 Ti8 GB · usable 7 GBTIGHT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 308010 GB · usable 8.8 GBGOOD · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 2080 Ti11 GB · usable 9.7 GBGOOD · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 407012 GB · usable 10.6 GBEXCELLENT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 3060 12GB12 GB · usable 10.6 GBEXCELLENT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 507012 GB · usable 10.6 GBEXCELLENT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 4070 Super12 GB · usable 10.6 GBEXCELLENT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 4070 Ti12 GB · usable 10.6 GBEXCELLENT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 3080 Ti12 GB · usable 10.6 GBEXCELLENT · 6.8 GBOFFLOAD REQUIRED · 10.9 GB
RTX 408016 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RTX 508016 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RTX 4060 Ti 16GB16 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RTX 5060 Ti 16GB16 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RTX 5070 Ti16 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
Mac mini M6 16GB16 GB · usable 10.4 GBEXCELLENT · 6.8 GBNOT RECOMMENDED · 10.9 GB
RTX 4070 Ti Super16 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RX 9070 XT16 GB · usable 14.1 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RTX 309024 GB · usable 21.1 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
RTX 409024 GB · usable 21.1 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
Mac mini M5 Pro 24GB24 GB · usable 15.6 GBEXCELLENT · 6.8 GBGOOD · 10.9 GB
RX 7900 XTX24 GB · usable 21.1 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
RTX 3090 Ti24 GB · usable 21.1 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
RTX 509032 GB · usable 28.2 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
Mac Studio M5 Max 36GB36 GB · usable 23.4 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
Mac mini M4 Pro 64GB64 GB · usable 44.8 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
Mac Studio M4 Max 64GB64 GB · usable 44.8 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
Mac Studio M3 Ultra 96GB96 GB · usable 67.2 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
Mac Studio M5 Ultra 96GB96 GB · usable 67.2 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB
NVIDIA DGX Spark128 GB · usable 112.6 GBEXCELLENT · 6.8 GBEXCELLENT · 10.9 GB

Or rent an RTX 4090 from $1.00/h →Check it against your own machine →

What it is for

The rule is unchanged: the largest seven-day Heat Score gain among models that fit a 24 GB card with margin and were not picked in the last four weeks; ties break by the higher score. Between the readings of 17 and 23 October, both at 18:15 UTC, Qwen3 8B rose from 45 to 65. Qwen3 4B gained the same 20 points and lost the tie on score, 50 against 65. Three models moved more and were out on the rule: DeepSeek-V4-Flash gained 28 and Ornith 1.5 397B gained 23, neither fits a 24 GB card at 8K; Granite 4.2 3B gained 24 but stands at 43 today, below the 50 a counted rise requires.

The gain is a trending gain, not a download gain, and the report should say so. The Hub's trending score for Qwen3 8B went from 6 on 17 October to 14 on 23 October, which put it in the top two percent of tracked models on that component. Its 30-day downloads fell over the same window, from 9.34 million to 8.08 million, down 13 percent over the window. The model was released in April 2025; what moved this week is attention on the Hub, and the rule counts attention. We do not know why, and the data does not say.

What we measure is the file and the shape. Qwen3 8B is a dense model of 8.2 billion parameters, and the Q4_K_M weights weigh 4.7 GB. Its 36 layers all cache the full context, 8 KV heads at 128 dimensions each, so the cache grows with every token: 1.1 GB at 8K, 4.5 GB at 32K. At 8K context the engine computes 6.8 GB in total: TIGHT on the 8 GB cards (6.8 of 7.0 usable), GOOD on the RTX 3080 and RTX 2080 Ti, EXCELLENT from 12 GB upward, the RTX 3060 12GB, 4070 and 5070 included. At 32K the total is 10.9 GB, and the 12 GB cards miss it by less than half a gigabyte (10.9 against 10.6 usable): OFFLOAD_REQUIRED on everything up to 12 GB, GOOD on the 16 GB cards and the Mac mini M5 Pro 24GB, EXCELLENT from 24 GB. The config publishes a window of 40,960 tokens. Last week's pick, LFM2.5 8B-A1B, needs 0.38 GB of cache at 32K where this one needs 4.5; the two files are within 0.1 GB of each other.

Renting a 24 GB card for a model that needs 6.8 GB at 8K is the wrong tool, and at 32K it is still twice the memory the job needs. The pick card froze an RTX 4090 hour on Vast.ai at $1.00, the 18:00 UTC hourly median across 37 offers; this week's median for the class was $0.60 and last week's $0.53. A 12 GB card that is already in your machine runs it at 8K, a 16 GB card at 32K. If you do rent for 32K work, the RTX 3090 class has the same 24 GB: at 16:00 UTC RunPod posted $0.22 per hour and the Vast.ai median was $0.35 across 35 offers.

Maker
Alibaba Qwen
Parameters
8.2B
Measured GGUF
Q4_K_M · 4.7 GB
Max context
40K tokens
Curated for
general, coding, agents
Repo created
2025-04-27
Trending score
14
7-day downloads
-14.2%

Model pageHugging Face repo (External link)GGUF file (External link)

Downloads, daily readingsdaily last · UTC

2026-10-10 · 9.8M2026-10-23 · 8.1M

Watch out

  • The rent figure on this card is the 18:00 UTC hourly Vast.ai median for the RTX 4090 (37 offers); this week's median for the class was $0.60 and last week's $0.53. Hourly medians move with which offers happen to be listed.
  • This week's rise came from the Hub's trending score (6 to 14) while 30-day downloads fell 13 percent; the Heat Score weights both, and a trending rise alone can move it by this much.
  • Heat Score measures attention on the Hub (downloads, trending, likes), not quality. We publish no benchmarks and no speed figures for this or any model.
  • The 40,960-token window is the model's published config. The maker's model card describes a longer window with YaRN scaling, which we do not measure; the cache figures above stop at the config.
  • Fit verdicts assume llama.cpp-style inference with the measured Q4_K_M GGUF and an f16 cache; other runtimes, quantized caches and other quantizations change the numbers.

How we chose it

Pick of the week is the model with the largest Heat Score rise over the last seven days among tracked models that run comfortably (GOOD or EXCELLENT) on at least one consumer card of up to 24 GB at 8K context. A rise counts only when it is at least three points, the model's Heat Score is at least 50 today, and the model's own direction is not falling — a low score that climbs while the models around it fall has only moved because they moved. Ties break by the higher Heat Score, then by 30-day downloads. A model cannot be picked again within four weeks. While the heat history is younger than a week, the rise is measured over the readings that exist and the report says so; when no rise counts, the rule falls back to the highest Heat Score and records that.

This issue was selected on the heat rise. Rise measured since 2026-10-17 18:15 UTC. 46 scored models were considered; the full list with reasons is stored with the issue.

The rule on the methodology page · rule v1.2 · selected 2026-10-23 18:17 UTC

Issues

A new pick every Friday. The model is computed, the text is written and released by a person, and every number links back to where it was measured.

RSS feed of every issue · JSON: /api/v1/pick

The Tower Report · every Monday

Monday's board, in your inbox.

Prices, the pick, what newly fits your card. Measured, never forecast. One mail a week, one click to leave.

Name your card and every issue opens with what it runs this week. You can change it by subscribing again with the same address.

Double opt-in; you confirm by one click. Details in the privacy policy · what is in an issue