long-context
taxonomy axis: design_intent
Decision rule: Framed primarily around context length.
Anchor: Gemini 1.5 (if in atlas)
Models in this category (3)
| Model | Org | Date | Block | Attention | Context | Total | Active |
|---|---|---|---|---|---|---|---|
| LongCat-Flash | Meituan LongCat Team | 2026-01-29 | sparse-MoE | not disclosed | 131,072 | 68.5B | 2.9B |
| DeepSeek-V4 | DeepSeek-AI | 2026-04-26 | sparse-MoE | hybrid | 1M | 1.6T | 49B |
| MiniMax M3 | MiniMax (with authors from Peking University, NVIDIA, Zhejiang University, HUST, Nanjing University, Hangzhou Dianzi University) | 2026-06-11 | sparse-MoE | GQA | not disclosed | 109B | 6B |
What varies within this category
attention variant varies — GQA, hybrid, not disclosed. trained context varies — 1000000, 131072, not disclosed. scale class varies — frontier, large.