Skip to content
AI Compute Radar
IndexCollected 19 min ago

Gate: the smallest device it runs on easily at 32K context. Seat: the measured GGUF file.

Pick of the week — Week 45, 2026 · selected by rule, written by people

A 2 GB file that runs on everything we track

Granite 4.2 3B by IBM takes the ninth pick: the largest popularity gain between the readings of 31 October and 6 November among models that run comfortably on a 24 GB card and are not on cooldown. Its Q4_K_M file measures 2.1 GB, read from IBM's own GGUF repository. At 8K context it needs 3.6 GB and runs easily on every card and Mac we track, the 8 GB cards included; at 32K it needs 6.3 GB, runs on the 8 GB cards and runs easily from 11 GB up.

Measured signals as of 2026-11-06 18:15 UTC · Hugging Face + Vast.ai · method on /methodology

Where it runs

Fit engine · measured GGUF + computed KV cache · usable memory after margins
Device8K context32K context
RTX 30708 GB · usable 7 GBRuns easily · 3.6 GBRuns · 6.3 GB
RTX 40608 GB · usable 7 GBRuns easily · 3.6 GBRuns · 6.3 GB
RTX 50608 GB · usable 7 GBRuns easily · 3.6 GBRuns · 6.3 GB
RTX 3060 Ti8 GB · usable 7 GBRuns easily · 3.6 GBRuns · 6.3 GB
RTX 308010 GB · usable 8.8 GBRuns easily · 3.6 GBRuns · 6.3 GB
RTX 2080 Ti11 GB · usable 9.7 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 407012 GB · usable 10.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 3060 12GB12 GB · usable 10.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 507012 GB · usable 10.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 4070 Super12 GB · usable 10.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 4070 Ti12 GB · usable 10.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 3080 Ti12 GB · usable 10.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 408016 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 508016 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 4060 Ti 16GB16 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 5060 Ti 16GB16 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 5070 Ti16 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac mini M6 16GB16 GB · usable 10.4 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 4070 Ti Super16 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RX 9070 XT16 GB · usable 14.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 309024 GB · usable 21.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 409024 GB · usable 21.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac mini M5 Pro 24GB24 GB · usable 15.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RX 7900 XTX24 GB · usable 21.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 3090 Ti24 GB · usable 21.1 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
RTX 509032 GB · usable 28.2 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac Studio M5 Max 36GB36 GB · usable 23.4 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac mini M4 Pro 64GB64 GB · usable 44.8 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac Studio M4 Max 64GB64 GB · usable 44.8 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac Studio M3 Ultra 96GB96 GB · usable 67.2 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
Mac Studio M5 Ultra 96GB96 GB · usable 67.2 GBRuns easily · 3.6 GBRuns easily · 6.3 GB
NVIDIA DGX Spark128 GB · usable 112.6 GBRuns easily · 3.6 GBRuns easily · 6.3 GB

Or rent an RTX 4090 from $0.51/h →Check it against your own machine →

What it is for

The rule is unchanged: the largest seven-day popularity gain among models that fit a 24 GB card with margin and were not picked in the last four weeks; ties break by the higher score. Between the readings of 31 October and 6 November, both at 18:15 UTC, Granite 4.2 3B gained more than any other eligible model. Qwen AgentWorld 35B-A3B gained almost as much, but its 20.6 GB file spills into RAM on a 24 GB card at 8K, so it is out. GLM-4.7-Flash is the runner-up: its 17.1 GB file runs on a 24 GB card at 8K. Qwen3.8 27B, a 15.3 GB file that also runs on 24 GB, gained the third most, Ling 3.0 Tiny the fourth. LFM2.5 8B-A1B was picked in week 42 and sits on cooldown until week 47; Qwen3 32B gained but stays under the score floor.

The signals behind the gain are a trending move more than a download move, and the report should say so. Its 30-day downloads went from 35,342 on 31 October to 37,286 on 6 November, up 5 percent; its Hugging Face trending score went from 4 to 11 in the same week, which put it in the top ten of the 48 models we track. The popularity score ranks every component against the other tracked models, and 31 of the 48 lost 30-day downloads over this window, so a small model that held and trended rose past larger ones that merely held. Released on 7 August 2026 under Apache 2.0, it is the first Granite pick since Granite 4.2 8B in week 40, and the smallest model picked so far.

What we measure is the file and the shape. The model carries 3.66 billion parameters, dense, and the Q4_K_M weights, read from IBM's GGUF repository, weigh 2.1 GB. The config publishes 40 layers that all cache the full context, with 8 KV heads of 64 dimensions, a narrow cache for a dense model: 0.6 GB at 8K, 2.5 GB at 32K, 10.0 GB at the full 131,072-token window. At 8K the engine computes 3.6 GB in total, which runs easily on everything we track, from the 8 GB cards and the 16 GB Mac mini up. At 32K the total is 6.3 GB: the 8 GB cards run it with 7.0 GB usable, and from the RTX 2080 Ti at 11 GB upward it runs easily. At the full 128K window the total is 16.8 GB, of which 4.7 GB is our assumed runtime overhead at that length: it runs on the 16 GB cards and runs easily on 24 GB. Last week's pick, Gemma 4 E4B, is a 4.6 GB file that needs 7.2 GB at 32K; this one needs 6.3 GB from half the file, because its cache is larger and its weights are smaller.

Renting for this model is the wrong tool almost everywhere: an 8 GB card you already own runs it at 32K. If the job is the full 128K window on a card you do not have, the RTX 3090 class has the 24 GB it wants: at 18:00 UTC the Vast marketplace median for an RTX 3090 hour was $0.23 across 64 offers, and RunPod's posted price was $0.22. The pick card freezes an RTX 4090 hour on the Vast marketplace at the 18:00 UTC hourly median; this week's median for the class was $0.48 and last week's $0.53.

Maker
IBM
Parameters
3.7B
Measured GGUF
Q4_K_M · 2.1 GB
Max context
128K tokens
Curated for
general, agents
Repo created
2026-08-07
Trending score
11
7-day downloads
+4.1%

Model pageHugging Face repo (External link)GGUF file (External link)

Downloads, daily readingsdaily last · UTC

2026-10-24 · 39K2026-11-06 · 37K

Watch out

  • The rent figure on this card is the 18:00 UTC hourly Vast marketplace median for the RTX 4090; this week's median of daily medians for the class was $0.48 and last week's $0.53. Hourly medians move with which offers happen to be listed.
  • This week's gain is a trending-score move more than a download move: downloads rose 5 percent while the Hugging Face trending score went from 4 to 11, and 31 of the 48 tracked models lost 30-day downloads over the window. The popularity score is percentile-based by design, and a quiet week for the field lifts the models that merely held.
  • Popularity measures attention on the Hub (downloads, trending, likes), not quality. We publish no benchmarks and no speed figures for this or any model.
  • The 128K figure includes 4.7 GB of runtime overhead, which is an assumption of our engine for that context length, not a measurement; the weights are measured, the cache is computed from the config.
  • Fit verdicts assume llama.cpp-style inference with the measured Q4_K_M GGUF and an f16 cache; other runtimes, quantized caches and other quantizations change the numbers.

How we chose it

Pick of the week is the model with the largest Heat Score rise over the last seven days among tracked models that run comfortably (GOOD or EXCELLENT) on at least one consumer card of up to 24 GB at 8K context. A rise counts only when it is at least three points, the model's Heat Score is at least 50 today, and the model's own direction is not falling — a low score that climbs while the models around it fall has only moved because they moved. Ties break by the higher Heat Score, then by 30-day downloads. A model cannot be picked again within four weeks. While the heat history is younger than a week, the rise is measured over the readings that exist and the report says so; when no rise counts, the rule falls back to the highest Heat Score and records that.

This issue was selected on the heat rise. Rise measured since 2026-10-31 18:15 UTC. 48 scored models were considered; the full list with reasons is stored with the issue.

The rule on the methodology page · rule v1.2 · selected 2026-11-06 18:56 UTC

Issues

A new pick every Friday. The model is computed, the text is written and released by a person, and every number links back to where it was measured.

RSS feed of every issue · JSON: /api/v1/pick

The Tower Report · every Monday

Monday's board, in your inbox.

Prices, the pick, what newly fits your card. Measured, never forecast. One mail a week, one click to leave.

Name your card and every issue opens with what it runs this week. You can change it by subscribing again with the same address.

Double opt-in; you confirm by one click. Details in the privacy policy · what is in an issue

Keep reading