Shopify

Simulating Humanity: from Generative Agents to 8 Billion Digital Twins — Joon Sung Park, Simile AI

Aug 21, 2026 · 1:11:01

Joon Sung Park, co-founder and CEO of Simile AI, joins Latent Space to argue that simulating humans requires bespoke behavior models, not just frontier LLMs, a bet rooted in his Generative Agents/Smallville paper. Frontier models optimized to be rational miss how people actually err, scoring 20–30% on niche populations, whereas Simile's digital twins match people's own responses 85% of the time. He details the three data buckets—interviews, observational data, and randomized controlled trials—and shows how companies use the platform for concept testing, A/B tests, and earnings calls. Park also shares the scaling-law glimpse in simulation, the economics of data-center-scale worlds, and his vision of simulating all 8 billion people to tackle wicked problems like climate change and UBI, with Thomas Schelling's agent-based models as precedent.

AI-Native Engineering: 100% adoption, 5x search throughput, unlimited tokens — Mikhail Parakhin

Apr 22, 2026 · 1:14:30

Shopify CTO Mikhail Parakhin details how the company achieved near 100% AI tool adoption, driven by a December 2025 inflection point where model quality triggered exponential token consumption. He argues token budgets matter only with strong critique loops: running multiple parallel agents without communication wastes tokens, while agentic PR review using large models—like GPT-5.4 Pro or Gemini Deep Think—reduces bugs even though latency increases. Parakhin unveils Tangle, Shopify's third-generation ML workflow system with content-based caching that eliminates duplicate computation across teams, and Tangent, an auto-research loop that optimizes pipelines—boosting search throughput from 800 to 4,200 QPS on the same hardware. SimGym simulates shoppers using decades of merchant data and browser-based agents to predict conversion changes, achieving 0.7 correlation with add-to-cart events. Shopify uses Liquid AI (non-transformer architecture) for sub-30ms query understanding and long-context tasks like catalog categorization, distilling larger models into Liquid for high-throughput batch jobs.

Retrieval After RAG: Hybrid Search, Agents, and Database Design — Simon Eskildsen of Turbopuffer

Mar 12, 2026 · 1:00:32

Simon Eskildsen, founder of Turbopuffer, explains how his obsession with the cost of vector search at Readwise led him to build a search engine on object storage and NVMe SSDs, cutting costs by 95% for customers like Cursor. He outlines the three conditions for a major database company—a new workload (AI-driven search), a new architecture (object storage first, no consensus layer), and evolving to support every query plan. Turbopuffer's architecture uses S3's strong consistency and compare-and-swap for metadata, avoiding stateful systems. Eskildsen shares how they won Notion by absorbing latency issues with dark fiber, and discusses the shift from single RAG queries to agents making many concurrent searches. He also describes the "P99 engineer"—obsessive, trade-off minded, able to bend software to first principles. Future plans include expanding full-text search, reaching Common Crawl scale, and eventually adding simpler OLAP queries.

The Creators of Model Context Protocol

Apr 3, 2025 · 1:20:21

Justin Spahr-Summers and David Soria Parra, co-creators of Anthropic's Model Context Protocol (MCP), explain its origin as a solution to the M×N integration problem they experienced when copying data between Claude Desktop and IDEs. They detail MCP's design inspirations from LSP, its three core primitives (tools for model-driven actions, resources for app-controlled data, and prompts for user-initiated macros), and why they chose JSON-RPC with stateful connections. The episode contrasts MCP with OpenAPI, discusses client control and trust in servers, and outlines the future roadmap including a streamable HTTP transport and remote-server authorization via OAuth 2.1. The guests express a wish for more sampling clients and full spec support, and emphasize that MCP is an open, multi-company project with community commit access.