Skip to content
AI Compute Radar
IndexCollected 31 min ago

Gate: the smallest device it runs on easily at 32K context. Seat: the measured GGUF file.

Pick of the week — Week 44, 2026 · selected by rule, written by people

8 billion on disk, under a gigabyte of context at 32K

Gemma 4 E4B by Google takes the eighth pick: Heat Score 59 to 76 between the readings of 24 and 30 October, the largest gain among models that run comfortably on a 24 GB card and are not on cooldown. Its Q4_K_M file measures 4.6 GB. At 8K context it needs 5.8 GB, it runs on the 8 GB cards and runs easily from 10 GB up; at 32K it needs 7.2 GB, and only 0.9 GB of that is context cache, a fifth of what last week's pick needs at the same length.

Measured signals as of 2026-10-30 18:15 UTC · Hugging Face + Vast.ai · method on /methodology

Where it runs

Fit engine · measured GGUF + computed KV cache · usable memory after margins
Device8K context32K context
RTX 30708 GB · usable 7 GBRuns · 5.8 GBSpills into RAM · 7.2 GB
RTX 40608 GB · usable 7 GBRuns · 5.8 GBSpills into RAM · 7.2 GB
RTX 50608 GB · usable 7 GBRuns · 5.8 GBSpills into RAM · 7.2 GB
RTX 3060 Ti8 GB · usable 7 GBRuns · 5.8 GBSpills into RAM · 7.2 GB
RTX 308010 GB · usable 8.8 GBRuns easily · 5.8 GBRuns · 7.2 GB
RTX 2080 Ti11 GB · usable 9.7 GBRuns easily · 5.8 GBRuns · 7.2 GB
RTX 407012 GB · usable 10.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 3060 12GB12 GB · usable 10.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 507012 GB · usable 10.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 4070 Super12 GB · usable 10.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 4070 Ti12 GB · usable 10.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 3080 Ti12 GB · usable 10.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 408016 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 508016 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 4060 Ti 16GB16 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 5060 Ti 16GB16 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 5070 Ti16 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac mini M6 16GB16 GB · usable 10.4 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 4070 Ti Super16 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RX 9070 XT16 GB · usable 14.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 309024 GB · usable 21.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 409024 GB · usable 21.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac mini M5 Pro 24GB24 GB · usable 15.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RX 7900 XTX24 GB · usable 21.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 3090 Ti24 GB · usable 21.1 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
RTX 509032 GB · usable 28.2 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac Studio M5 Max 36GB36 GB · usable 23.4 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac mini M4 Pro 64GB64 GB · usable 44.8 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac Studio M4 Max 64GB64 GB · usable 44.8 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac Studio M3 Ultra 96GB96 GB · usable 67.2 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
Mac Studio M5 Ultra 96GB96 GB · usable 67.2 GBRuns easily · 5.8 GBRuns easily · 7.2 GB
NVIDIA DGX Spark128 GB · usable 112.6 GBRuns easily · 5.8 GBRuns easily · 7.2 GB

Or rent an RTX 4090 from $0.49/h →Check it against your own machine →

What it is for

The rule is unchanged: the largest seven-day Heat Score gain among models that fit a 24 GB card with margin and were not picked in the last four weeks; ties break by the higher score. Between the readings of 24 and 30 October, both at 18:15 UTC, Gemma 4 E4B rose from 59 to 76. Qwen3 4B gained 14 and is the runner-up. Three models gained as much or nearly as much and were out on the rule: Qwen3.8 2.4T-A95B gained 15 and fits no 24 GB card; Llama 3.1 8B gained 15, but its config is gated, so the engine has no attention shape and gives no verdict, and a model without a verdict is not a fit; Gemma 4 31B gained 13 and barely fits a 24 GB card at 8K, which the rule does not count.

The signals behind the gain are modest, and the report should say so. The model's 30-day downloads went from 3.94 million on 23 October to 4.17 million on 30 October, up 6 percent; its Hub trending score went from 25 to 27, ninth among the 53 models we track today. The Heat Score ranks every component against the other tracked models, so a model can climb by holding steady while the field falls: of the 46 models with readings on both 24 and 30 October, 23 lost 30-day downloads over the window, and Gemma 4 E4B's 4 percent gain ranked fourteenth. It is the third Gemma 4 in eight picks, after the 12B in week 37 and the 26B-A4B in week 38, and the smallest of the three.

What we measure is the file and the shape. The E in the name is Google's label for an effective parameter count; the file carries 8.0 billion parameters, and the Q4_K_M weights, read from the published GGUF, weigh 4.6 GB. The config publishes 42 layers, of which 7 cache the full context with two KV heads of 512 dimensions, and 35 are sliding-window layers capped at 512 tokens. That shape is why the cache stays small: 0.25 GB at 8K, 0.9 GB at 32K, 3.5 GB at the full 131,072-token window. At 8K the engine computes 5.8 GB in total: it runs on the 8 GB cards (5.8 of 7.0 usable) and runs easily from the RTX 3080 upward. At 32K the total is 7.2 GB: the 8 GB cards miss it by 0.2 GB and spill into RAM, the RTX 3080 and RTX 2080 Ti run it, and everything from 12 GB runs it easily, the RTX 3060 12GB included. At the full 128K window the total is 12.9 GB, of which 4.7 GB is our assumed runtime overhead at that length: it spills into RAM on 12 GB, barely fits on 16 GB and runs easily on 24 GB. Last week's pick, Qwen3 8B, is a file of the same size, 4.7 GB, whose 36 layers all cache the full context; it needs 4.5 GB of cache at 32K where this one needs 0.9.

Renting a 24 GB card for a model that needs 7.2 GB at 32K is the wrong tool. The pick card froze an RTX 4090 hour on the Vast marketplace at $0.49, the 18:00 UTC hourly median across 64 offers; this week's median for the class was $0.53 and last week's $0.60. A 12 GB card that is already in your machine runs it at 32K with room to spare, and a 10 GB card runs it at 8K. If you do rent, and the job is the full 128K window, the RTX 3090 class has the same 24 GB: at 18:00 UTC the Vast marketplace median was $0.27 across 56 offers, and RunPod's posted price was $0.22 at its last reading of the day, 10:00 UTC.

Maker
Google
Parameters
8B
Measured GGUF
Q4_K_M · 4.6 GB
Max context
128K tokens
Curated for
general
Repo created
2026-03-02
Trending score
27
7-day downloads
+6%

Model pageHugging Face repo (External link)GGUF file (External link)

Downloads, daily readingsdaily last · UTC

2026-10-17 · 4.2M2026-10-30 · 4.2M

Watch out

  • The rent figure on this card is the 18:00 UTC hourly Vast marketplace median for the RTX 4090 (64 offers); this week's median for the class was $0.53 and last week's $0.60. Hourly medians move with which offers happen to be listed.
  • This week's rise is a rank effect as much as a signal: downloads rose 6 percent and the trending score by two points while 23 of 46 tracked models lost downloads. The Heat Score is percentile-based by design, and a quiet week for the field lifts the models that merely held.
  • Heat Score measures attention on the Hub (downloads, trending, likes), not quality. We publish no benchmarks and no speed figures for this or any model.
  • The 128K figures include 4.7 GB of runtime overhead, which is an assumption of our engine for that context length, not a measurement; the weights are measured, the cache is computed from the config.
  • Fit verdicts assume llama.cpp-style inference with the measured Q4_K_M GGUF and an f16 cache; other runtimes, quantized caches and other quantizations change the numbers.

How we chose it

Pick of the week is the model with the largest Heat Score rise over the last seven days among tracked models that run comfortably (GOOD or EXCELLENT) on at least one consumer card of up to 24 GB at 8K context. A rise counts only when it is at least three points, the model's Heat Score is at least 50 today, and the model's own direction is not falling — a low score that climbs while the models around it fall has only moved because they moved. Ties break by the higher Heat Score, then by 30-day downloads. A model cannot be picked again within four weeks. While the heat history is younger than a week, the rise is measured over the readings that exist and the report says so; when no rise counts, the rule falls back to the highest Heat Score and records that.

This issue was selected on the heat rise. Rise measured since 2026-10-24 18:15 UTC. 46 scored models were considered; the full list with reasons is stored with the issue.

The rule on the methodology page · rule v1.2 · selected 2026-10-30 18:53 UTC

Issues

A new pick every Friday. The model is computed, the text is written and released by a person, and every number links back to where it was measured.

RSS feed of every issue · JSON: /api/v1/pick

Reading the pick of the week

As of today's readingsOn November 2, 2026 the current pick is Gemma 4 E4B, chosen for week 44, 2026, Heat Score 76 at the moment the rule ran, report published October 30, 2026. 8 picks have been published since the rule started. On cooldown and therefore not eligible for the next pick: Gemma 4 E4B (until week 48), Qwen3 8B (until week 47), LFM2.5 8B-A1B (until week 46), Ornith 1.5 9B (until week 45). The rule runs next on November 6, 2026 at 18:15 UTC, right after the Friday Heat run.

One model a week, chosen by a fixed rule and explained in plain language. The rule is the whole editorial policy: the largest rise in the Heat Score over seven days among models that run comfortably on a consumer card of at most twenty-four gigabytes, with a minimum score, a minimum rise, and a four-week cooldown so the same model is not picked twice in a row. The readings are frozen at the moment the rule runs, and the frozen snapshot is what the report quotes, so a reader can check every number against the archive even after the live board has moved on.

The text around the rule is written by a person after the rule has decided. It says why the model moved, what the numbers behind the move were, what the fit table says about running it, and what to watch out for. It never argues with the rule and never substitutes taste for it: when the rule picks a model the editors would not have chosen, the report says so and explains the signals anyway.

What the pick is not: a benchmark result, a quality judgement, or a recommendation to buy or rent anything. The Heat Score measures attention on the Hub, downloads, trending rank and likes; a model can rise because a release got noticed, not because it got better. The report's caveats section exists to say that each week in the specific terms of that week's pick.

The Tower Report · every Monday

Monday's board, in your inbox.

Prices, the pick, what newly fits your card. Measured, never forecast. One mail a week, one click to leave.

Name your card and every issue opens with what it runs this week. You can change it by subscribing again with the same address.

Double opt-in; you confirm by one click. Details in the privacy policy · what is in an issue