Infrastructure · 3 pieces on file
Infrastructure
Serving stacks, kernels, GPU economics, and the gap between published throughput and what reproduces on real hardware.
Feature · JULY 7, 2026
DeepSeek quietly builds its own inference chip, targets Nvidia and Huawei dependency
Reuters reports the Hangzhou lab has spent about a year in talks with chip-design, foundry, and memory partners, hiring silicon engineers off-book while raising its first outside capital. Nvidia slipped 1.6% in premarket.
More in Infrastructure
-
JUNE 7, 2026
Apple licenses a 1.2T-parameter Gemini MoE for Siri, runs it on B200s inside Private Cloud Compute
Bloomberg, TechTimes and Google Cloud's own CEO line up the same architecture ahead of Monday's WWDC keynote: a custom mixture-of-experts Gemini, ~$1B/year, weights sitting on Nvidia B200s inside Apple-controlled enclaves.
-
MAY 12, 2026
vLLM v0.20.2 ships Model Runner V2: up to 56% higher throughput on GB200
The May 2026 stable release of vLLM bundles a new GPU-native Triton kernel async-scheduling stack, FP8 inference, and continuous batching as the default.