Tag: prefill
-
TensorFold 1.0.0 and Multi-Model gr8: Two Release Notes Date the Desk-Side Stack
by Chris DePuy, 650 Group / November 3, 2026. On November 2, the TensorFold Mac application and the gr8 cluster stack, two community inference projects this blog has followed all autumn, published release notes that move this hardware tier toward installed software. Ash Hart, the maintainer of the TensorFold Mac application, announced version 1.0.0, “our…
-
How to Flash DeepSeek V4.1 on an RTX 3090 Fidelity Check
by Chris DePuy, 650 Group / November 2, 2026 On October 29, an operator published a one-card Windows build for the full DeepSeek V4.1 Flash 1017 checkpoint. It ran on a single RTX 3090 with 192 GB memory and, in DGX Spark terms, served 41 tokens per second. The measurement that carries the story is…
-
DGX Spark Operators Add CPU Clock Caps to the Thermal Playbook
by Chris DePuy, 650 Group / November 1, 2026 A two-box DGX Spark operator capped the CPU side of a GB10 pair on Friday, October 30. The operator’s post reports the peak system-on-chip temperature under a ten-core load falling from 94 to 74 degrees Celsius, at a cost of 5 percent in prefill throughput and…
-
The RTX 30-Series Tensor Unlock: What the Measured Gains Cover and What They Miss
by Chris DePuy, 650 Group / October 29, 2026 An open-source Linux kernel module restores the full FP16/BF16 tensor rate on NVIDIA’s consumer RTX 30-series cards. The first complete benchmark suite in the lane, published this week by an independent operator, measured the matrix-side gain at 50 to 60 percent, and every report in the…
-
Five Spark Clusters, Two Kinds of Proof: TP5 GLM-5.3 Runs as Beam Sets the Efficiency Bar
by Chris DePuy, 650 Group / October 6, 2026 Five DGX Sparks now carry the full 753-billion-parameter GLM-5.3: an operator reported the first working five-board tensor-parallel build on Monday, with 1.5 million tokens of KV cache, prefill above 2,000 tokens per second, and 76 tokens per second single-stream — rising to 98–113 tokens per second…
-
New NVFP4 Checkpoints on Four DGX Sparks: The Results
Between September 9 and September 16, NVIDIA published first-party NVFP4 checkpoints for two frontier open-weight models, both MIT-licensed. One is a build of Z.ai’s GLM-5.3-Flash; the other is a build of DeepSeek’s DeepSeek-V4.1-Flash. Both labs produced them with NVIDIA Model Optimizer and validated both on rack-mount Blackwell silicon rather than on the desk. That distinction…
