Tag: Inference
-
Google Puts TPUv7 Through an Outside Agentic Benchmark
by Chris DePuy, 650 Group / October 25, 2026 Google’s first TPUv7 submission to an outside agentic-inference benchmark landed this week. The operator’s October 14, 2026 announcement reports FP8 results served through vLLM at 1.67x better performance per dollar than NVIDIA’s GB300 NVL72 at FP4 the operator’s announcement thread. The submission is the first submitted…
-
The System One Split: Jev, CUA-S1-FORMS, and the Decision Layer Coming Beneath the Agent Loop
by Chris DePuy / September 20, 2026 Between September 15 and 18, four related releases arrived within four days. TypeSafe AI emerged from two years of stealth with Jev, a model class the company calls System One, LangChain published an integration guide showing Jev wired into agent middleware, Browser Use open-sourced Jev Ultrafast, a browser-agent…
-
SGLang vs vLLM vs llama.cpp vs Atlas — The Inference Engine Shootout for DGX Spark Clusters
SGLang vs vLLM vs llama.cpp vs Atlas — The Inference Engine Shootout for DGX Spark Clusters The NVIDIA DGX Spark (GB10) has transformed from a curiosity into a genuine building block for local AI infrastructure. What began as a 128GB unified-memory desktop appliance has, through community effort and NVIDIA’s own software maturation, become a node…