gpt-oss-20b

gpt-oss-20b by openai: a 20.9B-parameter mixture-of-experts open-weight model under the apache-2.0 license.

apache-2.0Mixture of experts131K contextAuto-imported · not yet reviewed

6,708,152 downloads · 5,072 likes · Model card · synced 2026-09-19

Specifications

Parameters: 20.9B (2.6B active)
Architecture: moe · gpt_oss
Layers: 24
Hidden size: 2,880
KV heads · head dim: 8 · 64
Vocabulary: 201,088
Native dtype: —
Context window: 131,072 tokens
Released: 2025-08-04
Last modified on Hub: 2025-08-26

Features & licensing

License: apache-2.0
Commercial use: Yes
Modalities: text
Tool / function calling: No
Reasoning mode: No
Languages: EN
Quantised variants on Hub: GGUF, bitsandbytes
Pipeline: text-generation

transformerssafetensorsgpt_osstext-generationvllmconversationaleval-resultsendpoints_compatible8-bitmxfp4

Task fit

Editorial scores (0–100) used by the recommendation engine.

Chat70
RAG / Q&A70
Code70
Summarisation70
Extraction70
Agents70

Hardware to run gpt-oss-20b

Weights need about 46 GB at FP16, 24 GB at INT8 and 14 GB at INT4. The KV cache adds roughly 49 MB per 1,000 tokens per request. For a reference workload of 5 requests per second with 1,500 input and 300 output tokens, total GPU memory is around 17.7 GB, which fits on 1 × NVIDIA A100 (80 GB).

GPU configurations at the reference workload
Configuration	VRAM	Utilisation	Est. first token	Cloud / month
1 × NVIDIA L4 (24 GB)	24 GB	74 %	~0.5 s	$584
1 × NVIDIA L40S (48 GB)	48 GB	37 %	~0.2 s	$1,387
1 × NVIDIA A100 (80 GB)recommended	80 GB	22 %	~0.1 s	$2,336
1 × NVIDIA H100 (80 GB)	80 GB	22 %	~0.0 s	$3,285

Estimates only. Run an assessment for your own traffic.

Auto-imported from Hugging Face. Architecture, license and feature data are synced from the model repository; the task-fit scores below are provisional defaults until a curator reviews them.