MoE model
MoE model Articles
Browse 5 articles about MoE model.
Naive-N0.5-Flash: Inside the 309B MoE Model With 1M Native Context
Naive-N0.5-Flash pairs a 309B MoE architecture with hybrid SWA-DSA attention for native 1M-token context, built on MiMo-V2.5.
Naive-N0.5-FlashMoE model1M context window
MiMo-V2.6-Pro-RL: Xiaomi's 1T-Parameter Agentic Model, Explained
Xiaomi's MiMo-V2.6-Pro-RL is a 1T-parameter MoE model trained with large-scale RL. Here's how it compares to Claude Opus 5 and GPT-5.6.
MiMo-V2.6-Pro-RLXiaomi MiMo1T parameter model
DeepSeek-V4.1-Flash: How 890-Byte KV Cache Compression Works
DeepSeek-V4.1-Flash compresses KV cache to 890 bytes/token via a Causal Encoder-Decoder design. Full benchmarks vs GPT-5.6, Opus 5, K3, GLM-5.3.
DeepSeek-V4.1-FlashKV cache compressionDeepSeek benchmark
Tencent Hy4 Preview: Full Specs and How It Stacks Up to GLM 5.3, Kimi K3
Tencent's open-weight Hy4 preview MoE model edges out GLM 5.3 and Kimi K3 in blind engineering evals. Specs, architecture, and benchmarks explained.
Tencent Hy4 previewHy4 benchmarksGLM 5.3 vs Hy4
NVIDIA Nemotron 3.5 Lightning: A 30B MoE Built for Agent Grunt Work
NVIDIA's Nemotron 3.5 Lightning is a 30B-A3B open MoE model built for fast, cheap agent execution. Here's what its architecture and benchmarks mean.
Nemotron 3.5 LightningNVIDIA open modelMoE model