Tag: RoCE
-
NVIDIA Throws Official Support Behind Eight-Node DGX Spark Clusters
by Chris DePuy, 650 Group / November 2, 2026 NVIDIA has announced official support for eight-node DGX Spark clusters. The configuration scales unified memory from 128 GB on one machine to 1 TB across eight. As a result, frontier-class models fit on the desk. The company detailed the configuration, the benchmark data, and the supporting…
-
TensorFold 1.0.0 and Multi-Model gr8: Two Release Notes Date the Desk-Side Stack
by Chris DePuy, 650 Group / November 3, 2026. On November 2, the TensorFold Mac application and the gr8 cluster stack, two community inference projects this blog has followed all autumn, published release notes that move this hardware tier toward installed software. Ash Hart, the maintainer of the TensorFold Mac application, announced version 1.0.0, “our…
-
New GLM-5.3 on Four DGX Sparks: Results and Media Studio
On October 16, a community recipe put the full GLM-5.3 on four DGX Sparks, at tensor parallelism 4. The model is GLM-5.3 (753B), and the four NVIDIA DGX Spark units run it. Underneath is gr8, a from-scratch inference stack for the GB10 processor. The same weekend, keys/Wasserman AI Studio announced release 2.8.0 for Mac and…
-
The Spark Fleet Learns to Run Itself
by Chris DePuy, 650 Group / October 21, 2026 The last month of desk-side serving stories were about engines. Athena put two frontier models on one 128 GB box at 262K context with a 141,519-token conversation restored from disk in 2.1 seconds; Imprint turned that same restore trick into a standalone context-cache service with a…
-
Five Spark Clusters, Two Kinds of Proof: TP5 GLM-5.3 Runs as Beam Sets the Efficiency Bar
by Chris DePuy, 650 Group / October 6, 2026 Five DGX Sparks now carry the full 753-billion-parameter GLM-5.3: an operator reported the first working five-board tensor-parallel build on Monday, with 1.5 million tokens of KV cache, prefill above 2,000 tokens per second, and 76 tokens per second single-stream — rising to 98–113 tokens per second…
-
DeepSeek-V4.1-Flash on Four DGX Sparks: The Profile Day One Only Configured Now Boots, Serves and Passes a Million-Token Needle Test
by Chris DePuy / September 14, 2026 Late Sunday evening Pacific time, Mia AI Lab pushed a four-rank serving profile for DeepSeek-V4.1-Flash to its DGX Spark recipe, the same lab whose September 13 post on X put the model on four DGX Sparks and invited readers to run the stack themselves. The significance is not…
-
Day One on Three and Four Sparks: Community Recipes Put DeepSeek-V4.1-Flash on the Desk
by Chris DePuy / September 12, 2026 On September 10, DeepSeek released DeepSeek-V4.1-Flash, a multimodal mixture-of-experts model with a 552-billion-parameter backbone and a context window of one million tokens. The launch kits for NVIDIA’s desk-side DGX Spark machines arrived the same day: a four-machine stack on vLLM was serving requests by 9:17 Eastern time, roughly…
-
DeepSeek V4 Flash 0731 on the Multi-Node DGX Spark: From One Pair to an Eight-Node Cluster
by Chris DePuy / August 4, 2026 When DeepSeek shipped the official DeepSeek-V4-Flash-0731 weights on July 31, the community benchmarks that followed concentrated on single and dual DGX Spark units. Over the past several days a more interesting pattern has emerged as the same checkpoint moves up the cluster ladder, from a single GB10 to…
