Tag: FP8
-
Google Puts TPUv7 Through an Outside Agentic Benchmark
by Chris DePuy, 650 Group / October 25, 2026 Google’s first TPUv7 submission to an outside agentic-inference benchmark landed this week. The operator’s October 14, 2026 announcement reports FP8 results served through vLLM at 1.67x better performance per dollar than NVIDIA’s GB300 NVL72 at FP4 the operator’s announcement thread. The submission is the first submitted…
-
New NVFP4 Checkpoints on Four DGX Sparks: The Results
Between September 9 and September 16, NVIDIA published first-party NVFP4 checkpoints for two frontier open-weight models, both MIT-licensed. One is a build of Z.ai’s GLM-5.3-Flash; the other is a build of DeepSeek’s DeepSeek-V4.1-Flash. Both labs produced them with NVIDIA Model Optimizer and validated both on rack-mount Blackwell silicon rather than on the desk. That distinction…
-
DeepSeek-V4.1-Flash on Four DGX Sparks: The Profile Day One Only Configured Now Boots, Serves and Passes a Million-Token Needle Test
by Chris DePuy / September 14, 2026 Late Sunday evening Pacific time, Mia AI Lab pushed a four-rank serving profile for DeepSeek-V4.1-Flash to its DGX Spark recipe, the same lab whose September 13 post on X put the model on four DGX Sparks and invited readers to run the stack themselves. The significance is not…
-
GLM-5.3-Flash on a Single DGX Spark: Three Community Quantizations Fit Where the Vendor’s Does Not
by Chris DePuy / September 13, 2026 On September 9, NVIDIA published an official NVFP4 quantization of Z.ai’s GLM-5.3-Flash. Its Model Optimizer recipe leaves the key-value cache at FP8 and compresses only the linear layers inside the transformer blocks — the sparse-MoE shared experts and the dense MLP — from 16 bits down to 4,…
-
Day One on Three and Four Sparks: Community Recipes Put DeepSeek-V4.1-Flash on the Desk
by Chris DePuy / September 12, 2026 On September 10, DeepSeek released DeepSeek-V4.1-Flash, a multimodal mixture-of-experts model with a 552-billion-parameter backbone and a context window of one million tokens. The launch kits for NVIDIA’s desk-side DGX Spark machines arrived the same day: a four-machine stack on vLLM was serving requests by 9:17 Eastern time, roughly…
