Skip to content
AI Compute Radar
IndexCollected 1 h ago

Gate: the smallest device with an EXCELLENT fit at 32K context. Seat: the measured GGUF file.

Pick of the week — Week 41, 2026 · selected by rule, written by people

Five gigabytes again, context at a fifth of the price

Ornith 1.5 9B is this week's pick by rule: the largest counted Heat Score rise among tracked models that run comfortably on a consumer card, from 45 to 67 since the evening of 3 October. Its measured Q4_K_M file is 5.4 GB, only 8 of its 32 layers cache the whole context, and it fits a 12 GB card at 8K with 3.9 GB to spare and at 32K with 2.4 GB.

Measured signals as of 2026-10-09 18:15 UTC · Hugging Face + Vast.ai · method on /methodology

Where it runs

Fit engine · measured GGUF + computed KV cache · usable memory after margins
Device8K context32K context
RTX 30708 GB · usable 7 GBTIGHT · 6.7 GBOFFLOAD REQUIRED · 8.2 GB
RTX 40608 GB · usable 7 GBTIGHT · 6.7 GBOFFLOAD REQUIRED · 8.2 GB
RTX 50608 GB · usable 7 GBTIGHT · 6.7 GBOFFLOAD REQUIRED · 8.2 GB
RTX 3060 Ti8 GB · usable 7 GBTIGHT · 6.7 GBOFFLOAD REQUIRED · 8.2 GB
RTX 308010 GB · usable 8.8 GBGOOD · 6.7 GBTIGHT · 8.2 GB
RTX 2080 Ti11 GB · usable 9.7 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 407012 GB · usable 10.6 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 3060 12GB12 GB · usable 10.6 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 507012 GB · usable 10.6 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 4070 Super12 GB · usable 10.6 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 4070 Ti12 GB · usable 10.6 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 3080 Ti12 GB · usable 10.6 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 408016 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 508016 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 4060 Ti 16GB16 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 5060 Ti 16GB16 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 5070 Ti16 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac mini M6 16GB16 GB · usable 10.4 GBEXCELLENT · 6.7 GBGOOD · 8.2 GB
RTX 4070 Ti Super16 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RX 9070 XT16 GB · usable 14.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 309024 GB · usable 21.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 409024 GB · usable 21.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac mini M5 Pro 24GB24 GB · usable 15.6 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RX 7900 XTX24 GB · usable 21.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 3090 Ti24 GB · usable 21.1 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
RTX 509032 GB · usable 28.2 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac Studio M5 Max 36GB36 GB · usable 23.4 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac mini M4 Pro 64GB64 GB · usable 44.8 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac Studio M4 Max 64GB64 GB · usable 44.8 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac Studio M3 Ultra 96GB96 GB · usable 67.2 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
Mac Studio M5 Ultra 96GB96 GB · usable 67.2 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB
NVIDIA DGX Spark128 GB · usable 112.6 GBEXCELLENT · 6.7 GBEXCELLENT · 8.2 GB

Or rent an RTX 4090 from $0.49/h →Check it against your own machine →

What it is for

Ornith 1.5 9B is a 9.7-billion-parameter model from Ornith AI with open weights, curated here for general and coding work. The repository dates from 18 August 2026, Ornith AI's own organisation publishes the GGUF build we measure, and Ollama carries the family in its library as ornith. On 9 October it stood at 466,339 downloads over the last 30 days, up 1.8 % week on week, with 369 likes on Hugging Face and a trending score of 16. It accepts up to 262,144 tokens of context, and only 8 of its 32 layers keep a full attention cache; the other 24 hold a state that does not grow with context.

The move is a rebound, like last week's. The Heat Score had slid from 64 on 21 September to 40 on the 29th and stood at 45 on the evening of 3 October; then it went 47, 55, 60, 60, 64 and 67 on the following evenings. The readings behind it are mixed: the trending score went 15, 14, 18, 19, 20, 18 and 16, and downloads over 30 days fell from 455,080 to 449,256 by 7 October before rising to 466,339 in two evenings. The family moved together again: Ornith 1.5 35B-A3B rose 13 to 60, but its 20.2 GB file leaves no comfortable room on a 24 GB card, and Ornith 1.5 397B rose 8 to 23, far below the 50 a model needs. The runners-up were GLM-5.2 with a rise of 20 to 55, and Qwen3.8 Flash Next and Llama 3.1 8B with 15 each; none of the three gets a comfortable fit verdict on a card of up to 24 GB, Llama 3.1 8B because we hold no attention shape for it and the engine does not guess. Gemma 4 12B rose 13 to 55 but was picked in week 37 and is still on cooldown. Qwen3 14B, up 8 to 65, was the only other model that passed every test. Last week's pick, Granite 4.2 8B, sits at 41, sixteen points below where it was picked.

The weights are again the small part, and this time the context is cheap too. The Q4_K_M file is 5.4 GB, and because only 8 of 32 layers cache the whole context, every 8K tokens cost 0.25 GB, computed from the published attention shape; last week's Granite 4.2 8B charged 1.25 GB for the same 8K with all 40 layers caching. With runtime overhead the engine puts the total at 6.7 GB at 8K, 8.2 GB at 32K, 10.2 GB at 64K and 14.2 GB at 128K. That is EXCELLENT at 8K on every 12 GB card, from the RTX 3060 12GB to the RTX 4070 Ti, with 3.9 GB to spare, and still GOOD at 32K; the RTX 3080 is GOOD and the RTX 2080 Ti EXCELLENT at 8K. The 16 GB cards are comfortable up to 64K, the 24 GB cards up to 128K with 6.9 GB to spare, and the full 262,144 tokens take 22.2 GB, GOOD on the RTX 5090, TIGHT on the 36 GB Mac Studio and comfortable on the 64 GB Macs and the DGX Spark. Of the 32 machines we track, 28 run it comfortably at 8K and 27 at 32K. Renting instead of buying: an RTX 4090 cost $0.49 per hour at the median of 64 verified Vast.ai offers on 9 October at 20:00 UTC and an RTX 3090 $0.27; RunPod listed the same cards at $0.34 and $0.22 at that hour.

Maker
Ornith AI
Parameters
9.7B
Measured GGUF
Q4_K_M · 5.4 GB
Max context
256K tokens
Curated for
general, coding
Repo created
2026-08-18
Trending score
16
7-day downloads
+1.8%

Model pageHugging Face repo (External link)GGUF file (External link)

Downloads, daily readingsdaily last · UTC

2026-09-26 · 470K2026-10-09 · 466K

Watch out

  • Not an 8 GB card model without care: 6.7 GB at 8K against 7.0 GB usable leaves 0.3 GB, which the engine calls TIGHT on the RTX 3070, RTX 3060 Ti, RTX 4060 and RTX 5060, and 32K already spills 1.1 GB into system RAM.
  • The cheap context has a ceiling: 128K takes 14.2 GB, 0.1 GB more than a 16 GB card has usable, and the full 256K takes 22.2 GB, 1.1 GB more than an RTX 4090. A 24 GB card stops at 128K.
  • The rise starts from a trough. The Heat Score stood at 70 on 15 September and at 40 on 29 September; this week brought it to 67, three points short of its own high, not to new ground.
  • The readings behind the move are mixed: a trending score that peaked at 20 on 7 October and fell back to 16, and downloads that only turned up in the last two evenings. The 35B sibling rose in the same days; our readings do not say why, and the rule does not ask.
  • One measured GGUF, Q4_K_M from Ornith AI's own organisation; other quantizations change every number above. The context figures assume an f16 cache and count the 24 constant-state layers inside the runtime overhead. No benchmarks and no speed figures: whether it is good at your task is yours to test.
  • The rental prices are one marketplace median and one list price at one hour; they move during the day.

How we chose it

Pick of the week is the model with the largest Heat Score rise over the last seven days among tracked models that run comfortably (GOOD or EXCELLENT) on at least one consumer card of up to 24 GB at 8K context. A rise counts only when it is at least three points, the model's Heat Score is at least 50 today, and the model's own direction is not falling — a low score that climbs while the models around it fall has only moved because they moved. Ties break by the higher Heat Score, then by 30-day downloads. A model cannot be picked again within four weeks. While the heat history is younger than a week, the rise is measured over the readings that exist and the report says so; when no rise counts, the rule falls back to the highest Heat Score and records that.

This issue was selected on the heat rise. Rise measured since 2026-10-03 18:15 UTC. 46 scored models were considered; the full list with reasons is stored with the issue.

The rule on the methodology page · rule v1.2 · selected 2026-10-09 20:11 UTC

Issues

A new pick every Friday. The model is computed, the text is written and released by a person, and every number links back to where it was measured.

RSS feed of every issue · JSON: /api/v1/pick

The Tower Report · every Monday

Monday's board, in your inbox.

Prices, the pick, what newly fits your card. Measured, never forecast. One mail a week, one click to leave.

Double opt-in; you confirm by one click. Details in the privacy policy · what is in an issue