Head to head
vs For light moderate heavy
Verdict · measured basis
Gemma 3 12B costs $0.0000 per solved task against
gpt-oss-20b at $0.0003 — ▼ 5.4x cheaper .
Over 200 tasks that is $0.04 a month.
On output token price alone gpt-oss-20b looks 1.2x cheaper. The ranking reverses once you divide by pass rate — the cheaper tokens do not win the task.
Copy link Save scenario Export compare table Planned
Verified pricing, pass rate and cost per solved task for gpt-oss-20b and Gemma 3 12B Figure gpt-oss-20b Gemma 3 12B Input $/Mtok $0.03 $0.05 Output $/Mtok $0.13 $0.15 Cached input $/Mtok $0.03 $0.05 Pass rate 94% 67% Cost per solved task $0.0003 measured $0.0000 measured Cost per month $0.05 $0.01
Cost per month against tasks per month · drag the marker
Monthly cost against tasks per month Log-log lines for Gemma 3 12B (measured, $0.0000 per solved task), gpt-oss-20b (measured, $0.0003 per solved task) from 10 to 100,000 tasks a month. Marker at 200 tasks. 10 100 1k 10k 100k $0.001 $0.01 $0.1 $1 $10 TASKS / MONTH (log) → 200 tasks Gemma 3 12B · MEASURED · $0.0000 per solved task $0.01 Gemma 3 12B MEASURED gpt-oss-20b · MEASURED · $0.0003 per solved task $0.05 gpt-oss-20b MEASURED Monthly cost against tasks per month Log-log lines for Gemma 3 12B (measured, $0.0000 per solved task), gpt-oss-20b (measured, $0.0003 per solved task) from 10 to 100,000 tasks a month. Marker at 200 tasks. 10 100 1k 10k 100k $0.001 $0.01 $0.1 $1 $10 TASKS / MONTH (log) → 200 tasks Gemma 3 12B · MEASURED · $0.0000 per solved task $0.01 gpt-oss-20b · MEASURED · $0.0003 per solved task $0.05 — Gemma 3 12B · MEASURED — gpt-oss-20b · MEASURED Solid measured · dashed modeled · dotted stale. The gap is the verdict.
Solvency Bench (solvency.dev) — first-party measurement · verified 2026-08-26 · prices from each provider's pricing page; measured rows ignore the tier · Methodology · All models at these settings