Tag: NVFP4
-
NVIDIA Throws Official Support Behind Eight-Node DGX Spark Clusters
by Chris DePuy, 650 Group / November 2, 2026 NVIDIA has announced official support for eight-node DGX Spark clusters. The configuration scales unified memory from 128 GB on one machine to 1 TB across eight. As a result, frontier-class models fit on the desk. The company detailed the configuration, the benchmark data, and the supporting…
-
TensorFold 1.0.0 and Multi-Model gr8: Two Release Notes Date the Desk-Side Stack
by Chris DePuy, 650 Group / November 3, 2026. On November 2, the TensorFold Mac application and the gr8 cluster stack, two community inference projects this blog has followed all autumn, published release notes that move this hardware tier toward installed software. Ash Hart, the maintainer of the TensorFold Mac application, announced version 1.0.0, “our…
-
DGX Spark Operators Add CPU Clock Caps to the Thermal Playbook
by Chris DePuy, 650 Group / November 1, 2026 A two-box DGX Spark operator capped the CPU side of a GB10 pair on Friday, October 30. The operator’s post reports the peak system-on-chip temperature under a ten-core load falling from 94 to 74 degrees Celsius, at a cost of 5 percent in prefill throughput and…
-
New NVFP4 Checkpoints on Four DGX Sparks: The Results
Between September 9 and September 16, NVIDIA published first-party NVFP4 checkpoints for two frontier open-weight models, both MIT-licensed. One is a build of Z.ai’s GLM-5.3-Flash; the other is a build of DeepSeek’s DeepSeek-V4.1-Flash. Both labs produced them with NVIDIA Model Optimizer and validated both on rack-mount Blackwell silicon rather than on the desk. That distinction…
-
GLM-5.3-Flash on a Single DGX Spark: Three Community Quantizations Fit Where the Vendor’s Does Not
by Chris DePuy / September 13, 2026 On September 9, NVIDIA published an official NVFP4 quantization of Z.ai’s GLM-5.3-Flash. Its Model Optimizer recipe leaves the key-value cache at FP8 and compresses only the linear layers inside the transformer blocks — the sparse-MoE shared experts and the dense MLP — from 16 bits down to 4,…
-
Nemotron 3.5 Lightning: NVIDIA Carves Out an Agent Execution Layer for the Desk-Side
by Chris DePuy / August 12, 2026 NVIDIA this week released Nemotron 3.5 Lightning, an open 30B MoE model with just 3B active parameters, and I think it is the clearest signal yet that the deskside inference market is splitting into two distinct tiers. The model is built for the high-volume execution layer of long-running…
-
DFlash2 Beats DSpark for Qwen3.8-27B on One DGX Spark — and Jumps to Apple Silicon
by Chris DePuy / August 20, 2026 A week ago the Qwen3.8-27B decode race on a single NVIDIA DGX Spark was a contest between DSpark and MTP. This week the leading recipes on the same hardware have switched to a different engine: DFlash2, the block-diffusion speculative decoder that first shipped with DeepSeek, is now beating…
-
GLM-5.3-Flash Day Two: DFlash 2 Attacks the Decode Path While 1M-Context KV Moves Onto Two DGX Sparks
by Chris DePuy / August 28, 2026 A day after Z.ai opened weights on GLM-5.3-Flash, the desk-side community pushed the model past what I thought was its practical limit on small hardware. Two bottlenecks — the decode path and the KV cache — were attacked in parallel, and both moved in the same 24 hours.…