GLM-4.5 (ARC series)

Zhipu AI & Tsinghua University (GLM-4.5 Team) · 2025-08-08 · analysed 2026-08-10 · skill v0.3.5

sparse-MoE full-attention text-only open-weights frontier frontier-generalist

Design overview

GLM-4.5 is Zhipu AI's first MoE model: a 92-layer stack (89 MoE + 3 dense layers) with 355B total and 32B activated parameters, deliberately made deeper and narrower than DeepSeek-V3 or Kimi K2 (5120 hidden dim, 160 routed experts with 8 active plus 1 shared expert, per-expert intermediate dim 1536 against 12288 in the dense layers) because the team found depth helped reasoning. Attention is GQA with an unusual 96 query heads and only 8 KV heads (head dim 128), with QK-Norm on the flagship to stabilize attention logits and partial RoPE whose base is raised from 10,000 to 1,000,000 at the 32K context stage; context grows 4K → 32K → 128K across pre- and mid-training. Routing uses sigmoid gates with DeepSeek-V3-style loss-free bias balancing (bias update rate 0.001 for the first 15T tokens, then 0) plus a small sequence-level balance loss; the MTP layer is itself an MoE layer and doubles as the speculative-decoding draft. Training runs 23T tokens with the Muon optimizer (N=5 Newton-Schulz steps, weight decay 0.1, no dropout) under cosine decay, batch-size warmup 16M→64M tokens, and BF16 with FP8 rollout inference. Post-training is a two-stage expert iteration: three domain experts (Reasoning, Agent, General chat) are trained with SFT + RL (GRPO-family reasoning RL at a single 64K output length, agentic RL with iterative self-distillation, holistic/instruction/function-calling/pathology general RL), then distilled via SFT into one unified model that can answer in thinking or non-thinking mode — the 'hybrid reasoning' that defines the ARC series.

What the report claims is novel

Atlas assessment: Architecturally a conservative DeepSeek-V3-style MoE (sigmoid gating, loss-free bias-based balancing, one shared expert, MTP layer) with three notable deltas: GQA with 8 KV heads plus QK-Norm instead of DeepSeek-V3's MLA (the only atlas MoE besides K3 with QK-normed global attention), a depth-over-width geometry (5120 hidden, 92 layers, 160 experts vs DeepSeek-V3's 7168/61/256), and the Muon optimizer. Nothing in the block is genuinely new relative to atlas peers — kimi-k3's KDA/AttnRes axes are absent here; the report's novelty is concentrated in post-training (domain-expert iteration with self-distillation into a hybrid thinking/non-thinking generalist) and in the unusually aggressive head-count/QK-norm choice. The 3rd-overall/2nd-agentic ranking claims are internal to the report. The activation function, tokenizer, vocab size, and training compute are all undisclosed, which limits comparability with peers.

Relation to the atlas

Lineage in

Influence out

Notable omissions

Closest relatives in the atlas

Spec sheet

Identity

FamilyGLM-4.5 (ARC series)[1]
OrganisationZhipu AI & Tsinghua University (GLM-4.5 Team)[2]
Release date2025-08-08
Report URLhttps://arxiv.org/abs/2508.06471[3]
Licensenot disclosed
Open weightsyes[4]

Variants

Scale

Total parameters355B[5]
Active parameters / token32B[5]
Layers92
Hidden dimension5120[6]
FFN inner dimension1536[7]
FFN ratio0.3
Query heads96[8]
KV heads8[9]
Head dimension128[10]
Vocabulary sizenot disclosed
Embedding tyingnot disclosed

Per-variant configs

VariantTotalLayersHiddenFFNQ headsKV headsContext
GLM-4.5-Air106B4640961408968131,072

Core block

Block typesparse-MoE[11]
Attention variantGQA[12]
Attention layer patternuniform[13]
Depth mixingsequential-residual
Activationnot disclosed
Expert count160[14]
Experts per token8[15]
Shared experts1[16]
Routingsigmoid gates with loss-free balance routing[17]
Load balancingloss-free balance routing: expert bias update rate 0.001 for the first 15T tokens, then 0.0; auxiliary sequence-level balance loss with weight 0.0001 to avoid extreme imbalance within a single sequence[18]
Expert granularitycompact per-expert FFN (MoE intermediate dim 1536, 0.3× hidden) vs dense-layer intermediate 12288; report uses no fine-grained/grouped terminology
MethodRoPE[22]
RoPE base frequency1000000[23]
Partial RoPEyes[24]
TypeRMSNorm[25]
Placementnot disclosed
QK-normyes[26]
Attention sinksno
Softcappingno

Context

Trained context length131,072[27]
Deployed context length131,072[28]
Extension methodtrained at extended lengths: 4K → 32K → 128K across pre-/mid-training, with RoPE base frequency raised from 10,000 to 1,000,000 at the 32K stage[19]

Tokenizer

Algorithmnot disclosed
Notesnot disclosed

Training

Training tokens23T[29]
Data compositioncorpus of webpages, social media, books, papers, and code repositories: web documents bucketed by quality scores (Nemotron-CC-inspired; top bucket contributes over 3.2 epochs, lowest bucket discarded; MinHash + SemDedup deduplication); multilingual documents from crawled web and Fineweb-2 with educational-utility classifier up-sampling; code from GitHub and code hosting platforms with tiered quality models (high/medium/low) and Fill-In-the-Middle objective on all source code; math & science documents scored by an LLM and up-sampled above a threshold; two-stage pre-training: stage 1 general web documents, stage 2 up-sampled code, math, and science[30]
Curriculum / stagingtwo-stage pre-training (general documents, then up-sampled code/math/science); mid-training stages: repo-level code training (4K→32K, concatenated same-repo files, filtered issues/PRs/commits in diff format), synthetic reasoning data training, long-context & agent training (32K→128K, up-sampled long documents, synthetic agent trajectories); best-fit packing used only in mid-training (random truncation kept in pre-training)[31]
OptimizerMuon for all parameters except word embeddings, biases, and RMSNorm weights (Newton-Schulz iterations N=5, momentum 0.95, scaled Muon update RMS 0.2); weight decay 0.1; no dropout[32]
LR schedulecosine decay (chosen over warmup-stable-decay after experiments); warmup 0 → 2.5e-4, decaying to 2.5e-5 until the end of mid-training[32]
Batch schedulebatch size warmup: gradually increased from 16M to 64M tokens over the first 500B tokens, then constant[32]
PrecisionBF16 training with FP8 inference for RL rollouts (online block-wise FP8 quantization of parameters before rollout dispatch)[33]
ParallelismMegatron-based training (per Slime infra description); detailed TP/PP/EP/CP strategy not described[34]
Hardwarenot disclosed
Disclosed computenot disclosed

Post-training

SFTyes[35]
Preference optimisationGRPO[36]
Reasoning traininghybrid reasoning modes (thinking mode for complex reasoning/agentic tasks, non-thinking mode for instant responses); reasoning RL: two-stage difficulty-based curriculum (stage 2 problems verified pass@8==0, pass@512>>0), single-stage RL directly at 64K max output length (multi-stage progressive-length RL found inferior), dynamic sampling temperature (raised on convergence, capped by ≤1% validation drop), token-weighted mean loss for code RL, expert-verified MCQ-only data for science RL; agentic RL on web-search and SWE tasks with process format penalty and iterative self-distillation; test-time compute scaled via interaction turns; general RL: holistic RL (~5,000 prompts, 7/33/139 category taxonomy), instruction-following RL (7 major/151 minor constraint taxonomy, rule+RM+critique feedback), function-calling RL (step-wise rule-based + end-to-end multi-turn), pathology RL[37]
Distillationself-distillation (no external teacher): Stage 1 trains three domain experts (Reasoning, Agent, General chat); Stage 2 overall SFT distills expert outputs into one unified hybrid-reasoning generalist; agentic RL additionally uses iterative self-distillation (cold-start SFT data replaced by RL-trained responses before further RL)[38]

Modality

Typetext-only
Attachmentn/a[39]

Inference efficiency

KV-cache designGQA with 8 KV heads shared across 96 query heads: KV cache proportional to 8 heads (12× reduction vs 96-head MHA)
Quantisation shippednone disclosed[33]
Speculative decodingMTP (Multi-Token Prediction) MoE layer supporting speculative decoding during inference; MTP loss weight λ = 0.3 for the first 15T tokens, 0.1 after[18]
Serving optimisationsnone disclosed[33]

Evaluation

Benchmarks (report's own numbers only)

BenchmarkValueRef
TAU-Bench (Retail / Airline)79.7 / 60.4Table 3
BFCL V377.8Table 3
BrowseComp26.4Table 3
AIME 24 (Avg@32)91.0Table 4
GPQA (Avg@8)79.1Table 4
MMLU-Pro84.6Table 4
MATH 50098.2Table 4
SciCode41.7Table 4
HLE14.4Table 4
LiveCodeBench (2407-2501)72.9Table 4
SWE-bench Verified64.2Table 5
Terminal-Bench37.5Table 5
MMLU90.0Table 6
SimpleQA26.4Table 6
IFEval (Prompt Strict)86.1Table 6
SysBench (ISR)81.0Table 6
MultiChallenge52.8Table 6
SafetyBench (average)89.9Table 7
CC-Bench tool-calling success rate90.6§4.3.2
Novel logical reasoning (expert score)62.0Table 11
Challenging translation (human score 0-3)1.71Table 12

Provenance references

  1. stated · Title; §5 ('the GLM-4.5 model series, including GLM-4.5 and GLM-4.5-Air')
  2. stated · Title page byline
  3. stated · pipeline
  4. stated · Abstract ('We release both GLM-4.5 (355B parameters) and a compact version, GLM-4.5-Air (106B parameters)'); §1 (huggingface.co/zai-org/GLM-4.5); §5 ('We release the model weights of GLM-4.5 and GLM-4.5-Air')
  5. stated · Abstract; Table 1
  6. stated · Table 1 (Hidden Dim)
  7. stated · Table 1 (MoE Intermediate Dim)
  8. stated · Table 1 (# Attention Heads); §2.1 (96 heads for a 5120 hidden dimension)
  9. stated · Table 1 (# Key-Value Heads) — GQA
  10. stated · Table 1 (Attention Head Dim)
  11. stated · §2.1 ('we adopt the MoE architecture'); Table 1
  12. stated · §2.1 ('Grouped-Query Attention with partial RoPE'); Table 1 (96 Q heads / 8 KV heads)
  13. stated · §2.1 (GQA in the self-attention component; no per-layer hybrid described)
  14. stated · Table 1 (# Experts (total) 160)
  15. stated · Table 1 (# Experts Active Per Token)
  16. stated · Table 1 (# Shared Experts)
  17. stated · §2.1 ('We employ loss-free balance routing [40] and sigmoid gates for MoE layers [23]')
  18. stated · §2.1, §2.4
  19. stated · §2.3, §2.4
  20. n/a · §2.4 (base-frequency change, not an interpolation/rescaling factor)
  21. stated · §2.4 (max sequence length extended to 32,768 and 131,072 during mid-training)
  22. stated · §2.1 (partial RoPE); §2.4 (RoPE base frequency adjustment)
  23. stated · §2.4 ('we also adjusted RoPE's base frequency from 10,000 to 1,000,000' when extending to 32K)
  24. stated · §2.1 (Grouped-Query Attention with partial RoPE)
  25. stated · §2.4 ('weights for RMSNorm' excluded from the Muon optimizer)
  26. stated · §2.1 ('We also incorporate QK-Norm [15] to stabilize the range of attention logits'); Table 1 (QK-Norm: Yes)
  27. stated · §2.4 (max sequence length 4,096 during pre-training, extended to 32,768 and 131,072 in mid-training); §3.1 (overall SFT at max 128K)
  28. stated · §4.2.3 (evaluation 'prevent exceeding the 128K context limit')
  29. stated · Abstract ('multi-stage training on 23T tokens')
  30. stated · §2.2
  31. stated · §2.2, §2.3
  32. stated · §2.4
  33. stated · §3.5
  34. stated · §3.5 (Fig. 10: 'Training (Megatron) – handles the main training process')
  35. stated · §3.1 (cold-start SFT with extended CoT responses; overall SFT on millions of samples covering reasoning, general chat, agentic, and long-context tasks at 128K max context; function-call template with XML-like special token tags; rejection sampling; prompt selection with response-level scaling)
  36. stated · §3.2 ('Our overall RL algorithm builds upon the GRPO [31] framework, excluding the KL loss term'); §3.4 ('crucial during GRPO training')
  37. stated · §1, §3.2, §3.3, §3.4
  38. stated · §3, §3.3.2
  39. n/a · §1–§4 (text-only model)