Tag: AI Infrastructure
-
Google Puts TPUv7 Through an Outside Agentic Benchmark
by Chris DePuy, 650 Group / October 25, 2026 Google’s first TPUv7 submission to an outside agentic-inference benchmark landed this week. The operator’s October 14, 2026 announcement reports FP8 results served through vLLM at 1.67x better performance per dollar than NVIDIA’s GB300 NVL72 at FP4 the operator’s announcement thread. The submission is the first submitted…
-
Grok Bot, Two Weeks In: The Always-On Agent Workforce Gets a Shared Computer and a Shared Security Boundary
by Chris DePuy / August 29, 2026 xAI launched Grok Bot in early beta on August 11, and in the two weeks since, the community has made the platform’s ambition concrete faster than the company’s own launch materials do. The product is not another chat interface — a Bot gets its own cloud computer, signs…
-
SGLang vs vLLM vs llama.cpp vs Atlas — The Inference Engine Shootout for DGX Spark Clusters
SGLang vs vLLM vs llama.cpp vs Atlas — The Inference Engine Shootout for DGX Spark Clusters The NVIDIA DGX Spark (GB10) has transformed from a curiosity into a genuine building block for local AI infrastructure. What began as a 128GB unified-memory desktop appliance has, through community effort and NVIDIA’s own software maturation, become a node…