Grace Blackwell

Agent Inference at the "Speed of Light" — How NVIDIA moves like a $4.3 Trillion Startup

Mar 8, 2026 · 1:26:00

NVIDIA's Nader Khalil and Kyle Kranen join Swyx and Vibhu to explain how the company moves like a $4.3 trillion startup through speed-of-light (SOL) first-principles thinking, agent security boundaries, and the Dynamo inference engine. They argue agents should only do two of three things (files, internet, code) to prevent vulnerabilities, and detail Brev's acquisition to improve developer UX with one-click GPU access and DGX Spark integration. Kyle describes Dynamo as a data center scale inference engine that optimizes serving by scaling out, using prefill/decode disaggregation, Kubernetes-based scheduling, and model-hardware co-design to improve cost, latency, and quality. The episode covers SOL's role in creating urgency, long-context limits and potential 'unhobblers' like multi-head latent attention, and the shift toward CLI-first agent workflows for enterprise tools.

LIVE from GTC: DGX Spark Insides First Look

Mar 20, 2025 · 12:39

Israel from NVIDIA gives a first look at the DGX Spark, a $3,000–$4,000 mini AI supercomputer that fits up to 200B parameter models in FP4 with 128GB unified memory, powered by the NVIDIA GB10 Superchip. It uses the same Grace Blackwell architecture and software stack as data center systems, so code written on the Spark deploys to production without modifications. The device includes a ConnectX-7 dual-port 200Gb ethernet for clustering two units, and runs DGX OS (Ubuntu 24.04). Storage is 1TB or 4TB NVMe. Partners ASUS, HP, Dell, and Lenovo will offer their own cases. Israel stresses the Spark is a developer box, not a server, but delivers enterprise-grade networking and shared memory in a compact form.