Tag: MoE
-
Kimi K3: 2.8 Trillion Parameters, Open Weights — The New Frontier Ceiling
AI-generated concept image of a massive trillion-parameter AI supercomputer. Moonshot AI released Kimi K3 on July 16 — the largest open-weight model ever published at 2.8 trillion total parameters (Moonshot AI announcement). This isn’t a deskside model. It’s the new ceiling the quantization community needs to tackle. Architecture at a Glance Spec Value Total parameters…
-
DGX Spark Clusters by the Numbers: A Sizing Guide Across 1, 2, 3, and 4 Nodes
NVIDIA’s DGX Spark (GB10) started as a deskside curiosity — a 128GB unified-memory workstation drawing ~38W from the GPU during inference. Over the last several weeks, a wave of open-source recipes and community benchmarks has turned the Spark into a modular building block. Users are connecting 2, 3, and 4 units directly — no switch…