ChatGPT

Simulating Humanity: from Generative Agents to 8 Billion Digital Twins — Joon Sung Park, Simile AI

Aug 21, 2026 · 1:11:01

Joon Sung Park, co-founder and CEO of Simile AI, joins Latent Space to argue that simulating humans requires bespoke behavior models, not just frontier LLMs, a bet rooted in his Generative Agents/Smallville paper. Frontier models optimized to be rational miss how people actually err, scoring 20–30% on niche populations, whereas Simile's digital twins match people's own responses 85% of the time. He details the three data buckets—interviews, observational data, and randomized controlled trials—and shows how companies use the platform for concept testing, A/B tests, and earnings calls. Park also shares the scaling-law glimpse in simulation, the economics of data-center-scale worlds, and his vision of simulating all 8 billion people to tackle wicked problems like climate change and UBI, with Thomas Schelling's agent-based models as precedent.

OpenAI’s Vision for the AI Super App — Akshay Nathan, OpenAI

Jul 28, 2026 · 1:10:57

Akshay Nathan, OpenAI's head of core product engineering, explains why the company merged Codex and ChatGPT into a unified agent harness, arguing that the lines between software engineering and knowledge work are blurring. He reveals that Codex unexpectedly gained traction among non-developers at OpenAI, leading to the launch of ChatGPT Work, which shares the same underlying harness but offers opinionated UX differences like sandboxing and Git visibility. Nathan details how artifacts, Sites, plugins, memory, and sub-agents enable users to replace slide decks and spreadsheets with interactive websites, and shares that ChatGPT Work reached 10 million users shortly after launch. He discusses OpenAI's goal to bring useful agents from developers to all knowledge workers, emphasizing that the default model configuration should work for most users while power users can opt into deeper reasoning, Ultra, or multi-agent setups. Nathan also reflects on how AI transforms product development, noting that ideas and taste become the bottleneck when anyone can build, and warns managers not to conflate motion with progress.

The AI Frontier: from open weights to open research — Eiso Kant, Poolside AI

Jul 22, 2026 · 1:56:13

Poolside co-founder Eiso Kant argues that open weights and open research are essential for a future with many foundation model companies, and that models like their new Laguna S (118B parameters, 8B active) can achieve remarkable persistence and capability through post-training reinforcement learning. He explains how Poolside's Model Factory enables 5-8 week model cycles with 10,000-20,000 experiments per month, streaming data directly into training, and perfect reproducibility. Kant shares why Poolside embraced open source after starting as a closed company, criticizes MCP and tool calls in favor of models writing code directly, and predicts reinforcement learning will move earlier into pre-training. He also calls on researchers to start new foundation model companies to avoid an oligopoly of intelligence.

🔬Causal Models Need Causal Data - Xaira’s X-Cell model (Bo Wang & Ci Chu)

Jul 21, 2026 · 1:29:47

Bo Wang and Ci Chu from Xaira Therapeutics present X-Cell, a 4.9-billion-parameter diffusion language model trained on the largest genome-wide CRISPRi Perturb-seq dataset (25.6 million single cells, 16 biological contexts) that predicts cellular responses to genetic perturbations and generalizes from immortalized cell lines to primary T cells from real donors. They explain why observational atlases describe biology but can't predict interventions, why they abandoned autoregression for a diffusion 'editing' approach, and how a model trained on immortalized cells predicted perturbation responses in primary T cells. They highlight a counterintuitive scaling result: X-Cell scales like an LLM on training loss, but generalization is bottlenecked by data diversity, not compute. The episode also covers Xaira's three-platform strategy (protein design, virtual cell, patient representation) and the central thesis that for causal models, the hard part isn't the model, it's the data.

The AI Memory Problem: Why Long Context Isn’t Enough — Dan Biderman, Engram Co-founder & CEO

Jul 13, 2026 · 49:44

Engram co-founder and CEO Dan Biderman tells hosts Allen Park and Sean that long context and RAG aren't enough for AI memory—continual learning and gradient-based weight updates are needed. He argues Engram's approach compresses company knowledge into 'cartridges' that let models reason with far fewer tokens, overcoming 'context rot' and the inefficiency of re-reading massive corpora. Biderman draws on his background in Israeli special forces and computational neuroscience to explain how training creates intuition beyond text retrieval, citing examples like Harvey's legal queries where holistic understanding beats search. He envisions personal AI weights that improve like Tamagotchis, driven by user-specific feedback loops, and stresses that token efficiency and intelligence are inseparable—doing more with less enables harder problems. Engram is hiring infrastructure engineers to deploy millions of continuously updated memories.

Cooking with OpenAI’s Research Chief: AGI, o1, Evals, and Scaling Laws — Mark Chen

Jun 25, 2026 · 41:18

Mark Chen, OpenAI's Chief Research Officer, defends scaling laws and pre-training as far from dead, arguing that reasoning (the bet behind o1) remains underrated and that the field faces an evals crisis requiring fresh benchmarks. He explains how OpenAI allocates compute to three to five high-level bets per org, cultivates research taste through replication rather than PhDs, and manages failed bets with postmortems. Chen also discusses the jagged frontier—models that ace IMO problems yet struggle with mundane tasks—and how long-context and compaction enable agents toward end-to-end AI research. Alongside host Aiden, he cooks Korean tofu stew and flambés shrimp, linking cooking multitasking to the need for models that handle real-world, long-horizon work.

Why AI Labs With Unlimited GPUs Still Fail — Anjney Midha, AMP

Jun 18, 2026 · 1:00:37

Anjney Midha, CEO of AMP, argues that AI labs with unlimited GPUs still fail due to misaligned culture and infrastructure waste, proposing a compute grid modeled on independent system operators to pool demand and supply. At Google, 95% node utilization was considered an outage, yet most clusters today don't reach that, with waste compounding at scale. AMP’s grid, starting at scheduling, aims to make FLOPs flow like megawatts, having secured 1.3 gigawatts of demand. Midha explains Anthropic cracked coding because 'luck favors the prepared mind'—their four years of paranoia and scarcity created a culture that OpenAI’s abundance couldn't replicate. He also shares a 14-year mission in end-of-life prediction, arguing AI can reduce the 30% of Medicare/Medicaid spend on end-of-life care. He warns that too much capital too early makes labs fragile because without hardship they fail to define their P0.

🔬 The Limits of AI in Science - Why We Need Self-Driving Labs — Joseph Krause, Radical AI

Jun 17, 2026 · 1:16:50

Joseph Krause of Radical AI argues that the bottleneck in materials science is experiments, not ideas, and his company's self-driving lab combines AI hypothesis generation with automated synthesis and characterization to produce alloys at unprecedented speed—1,200 in six months, with 300 novel compositions and 10 already in commercial development. Radical's closed-loop system runs research campaigns, not just automated tasks, overcoming challenges like sample manipulation at 3,000°C and tool vendors' software access. Krause details how their AI explores elemental families humans overlooked, why they open-source models like Matrix (the moat is experimental data, not models), and how they plan to compress discovery timelines from decades to 3–5 years for defense and space applications. He addresses the 10-year qualification process for aerospace, supply chain geopolitics (e.g., hafnium price up 10–15x due to Chinese dominance), and the need for public-private partnerships to accelerate U.S. R&D. Finally, he urges ML engineers to lean into their expertise rather than try to become material scientists.

GitHub’s Agent Era: 14x Commits, 200M Developers, Copilot’s Next Act — Kyle Daigle

Jun 2, 2026 · 1:24:44

GitHub COO Kyle Daigle joins Swyx to unpack how the agent era is transforming GitHub's infrastructure and developer workflows, from 14x commit growth to internal AI micro-skills. Daigle describes using WorkIQ, MCP, and Slack/Teams context to retroactively analyze weeks' work and build executive presentations entirely with AI, undetected. He advocates atomic micro-skills over mega-skills and reveals GitHub now hosts 200M developers generating 275M weekly commits, on pace for 14B this year. Scaling issues stem from MySQL1 permissions and monorepo shifts, forcing rewrites of 10-year-old services. Copilot has evolved from code completion to a unified agent SDK powering CLI, desktop, and cloud agents. Microsoft's deep investment in OpenClaw reflects a need for OS-level sandboxing for enterprise agent deployment.

🔬How GPT‑5 derived new results in theoretical physics and quantum gravity — Alex Lupsasca, OpenAI

May 5, 2026 · 1:31:51

Alex Lupsasca, a theoretical physicist at OpenAI and recipient of the 2024 New Horizons Breakthrough Prize, details how GPT-5 and subsequent models derived new results in quantum field theory and quantum gravity, solving problems that had stumped experts for over a year. The work focused on 'single minus' gluon tree amplitudes, long believed to be zero, but which humans discovered might be non-zero in a special kinematic region. GPT-5.2 Pro conjectured a simplified formula for these amplitudes, and an internal OpenAI model later proved it, reducing a factorial number of Feynman diagram terms to a linear number. The AI then autonomously extended the result to graviton amplitudes using the gluon paper as a seed, producing a complete paper draft in under an hour. Lupsasca argues this marks a threshold where AI is superhuman on certain physics tasks, accelerating research by acting as a 'scout' that reduces confusion and suggests next questions. He also discusses challenges including AI slop on arXiv and the need for better verification methods.

⚡️ Competing with ChatGPT and Sierra, building a $10M ARR company — Yasser Elsaid, Founder, Chatbase

May 2, 2026 · 1:00:26

Yasser Elsaid, founder of bootstrapped AI chatbot company Chatbase, discusses how he grew from a side project to $10M ARR in three years, reaching $1M in just 117 days. He explains why he never raised VC, relying instead on product-led growth, self-serve signups, and a content-driven go-to-market strategy. Elsaid shares specific tactics like warm outbound to signed-up users, leveraging LinkedIn virality in early AI days, and now moving toward outcome-based pricing for enterprise customers. He details Chatbase's evolution from a simple RAG chatbot into a 'chief customer officer' that handles support, sales, and onboarding while surfacing business insights from conversations. The episode also covers his transition from Toronto to San Francisco, his hiring philosophy favoring results-oriented engineers, and his daily use of both Claude Code and Codex for development.

Extreme Harness Engineering: 1M LOC, 1B toks/day, 0% human code or review — Ryan Lopopolo, OpenAI

Apr 7, 2026 · 1:17:54

Ryan Lopopolo of OpenAI's Frontier team details his team's extreme experiment in harness engineering: building a 1M LOC internal Electron app with zero human-written or reviewed code, relying instead on Codex agents that process 1B tokens daily ($2-3k/day). He argues that humans are the bottleneck and that teams should encode non-functional requirements into specs, skills, and observability tooling rather than prompting agents to 'try harder.' The result is Symphony, a ghost library spec and Elixir reference implementation that automates the entire pull-request lifecycle, including self-review and merge. Lopopolo explains how the team scales by treating software as agent-legible text, using worktrees for multi-agent collaboration, and feeding agent mistakes back into the repository via docs like core-beliefs.md. He also discusses Frontier's enterprise platform for safe agent deployment, noting that success depends on giving agents full context—even company culture and inside jokes—so they can act as full teammates.

Marc Andreessen introspects on Death of the Browser, Pi + OpenClaw, and Why "This Time Is Different"

Apr 3, 2026 · 1:16:20

Marc Andreessen argues that AI is finally different from past boom-bust cycles because of four compounding breakthroughs: LLMs, reasoning (o1, R1), coding agents (OpenClaw), and recursive self-improvement. He calls this the '80-year overnight success'—decades of neural network research now paying off. Comparing today's AI capex boom to the dot-com crash, he notes that buyers like Microsoft and Google are cash-rich incumbents and every GPU deployed is already generating revenue. He hails Pi and OpenClaw as a Unix-like architecture that makes agents model-independent and self-modifiable. On open source, he calls DeepSeek a 'gift to the world' for its paper and code, but warns that entrenched institutions—unions, licensing, government monopolies—will slow AI adoption far more than technologists expect.

🔬There Is No AlphaFold for Materials — AI for Materials Discovery with Heather Kulik

Mar 24, 2026 · 35:15

Heather Kulik, MIT professor, demonstrates that AI can discover surprising new materials—such as a polymer made four times tougher via an unexpected quantum effect—but warns current models still fail basic chemistry tasks like generating a 22-atom ligand. She describes active learning with seven objectives to accelerate discovery of metal-organic frameworks for direct CO₂ capture, achieving hundred- to thousand-fold speedups per dimension. Kulik criticizes machine-learned potentials that 'look really good' but often produce nonsensical results, and notes that no large-scale experimental benchmark like CASP exists for materials. She calls for shared high-throughput cloud labs and standardized data reporting so published results are machine-learning-ready from day one. Her group's open-source tool MolSimplify (and MOFSimplify) generates transition-metal complexes and screens MOFs, and she invites feedback from users.

Dylan Patel Explains the AI War While Cooking | In-Context Cooking

Feb 26, 2026 · 55:13

Dylan Patel, CEO of SemiAnalysis, argues hyperscalers like Google, Amazon, and Meta will sacrifice all profits to build AI infrastructure, spending $180–$200 billion in capex this year alone, because the AI adoption explosion—Claude Code driving 4% of GitHub commits in one month, Anthropic adding $2.5 billion monthly revenue—makes it a Pascal's wager: spend or die. He details how Taiwan's semiconductor geopolitics create endgame scenarios, from a KMT win placating China to full invasion, with TSMC's output critical. Patel explains Nvidia's paranoid founder Jensen Huang is responding to vertical integration threats from hyperscalers by diversifying into chips like CPX and Groq, but warns moats are shallow. The real bottleneck in AI progress? Semiconductors themselves: fabs take years to build, and no one can buy enough GPUs through 2028. He also predicts a massive AI backlash from the public and financial markets, as capital consumption outpaces revenue and labor displacement accelerates.

Inside AI’s $10B+ Capital Flywheel — Martin Casado & Sarah Wang of a16z

Feb 19, 2026 · 55:31

Martin Casado and Sarah Wang of a16z argue that AI’s capital flywheel—where model labs translate funding directly into capability gains and revenue growth in weeks—is creating a new financing playbook that blends venture and growth, with rounds acting as compute contracts. They warn that frontier labs like Anthropic can potentially raise more money than the entire app ecosystem built on their APIs, allowing them to outspend and consume those layers. The episode examines the AGI vs. product dilemma in GPU allocation, the war for talent where $10M+ packages break early-stage founder math, and Cursor as a case study of building up from the app layer while training down into its own models. They also identify “boring” enterprise software as the most underinvested opportunity and note that robotics lacks a ChatGPT moment that would justify current funding levels.

⚡️ Prism: OpenAI's LaTeX "Cursor for Scientists" — Kevin Weil & Victor Powell, OpenAI for Science

Jan 27, 2026 · 36:00

Kevin Weil (VP of OpenAI for Science) and Victor Powell (Prism product lead) launch Prism, a free AI-native LaTeX editor that embeds GPT-5.2 directly into the scientific writing workflow, eliminating copy-pasting between ChatGPT and Overleaf and turning weeks of LaTeX formatting into minutes of natural language instruction. The origin story reveals Kevin discovered Victor's stealth company Cricket on Reddit and DM'd him to bring the team into OpenAI. In the live demo, Prism proofreads papers paragraph by paragraph, converts a whiteboard commutative diagram photo into TikZ code, generates 30 pages of general relativity lecture notes in seconds, and verifies complex symmetry equations in parallel chat sessions. They argue that LaTeX typesetting is the bottleneck diverting scientists from actual research, and that unlimited free collaboration and multi-line diff generation make Prism a 'tool for thought' rather than just a publishing tool. Kevin predicts 2026 will be for AI in science what 2025 was for AI in software engineering — a year when it becomes essential. The discussion also covers OpenAI's approach to accelerating science broadly, including the role of robotic labs and…

Brex’s AI Hail Mary — With CTO James Reggio (acquired for $5B by Capital One!)

Jan 17, 2026 · 1:13:27

Brex CTO James Reggio details the company's three-pillar AI strategy—corporate, operational, and product AI—arguing that SOP-driven agents outperform overengineered RL in finance ops like underwriting, KYC, and fraud. He explains why Brex built an internal AI platform (LLM gateway, prompt/version management, evals) before adopting Mastra for TypeScript-based multi-agent networks, where an EA-style orchestrator coordinates specialist agents via multi-turn conversations rather than single tool calls. The audit agent pattern separates detection, judgment, and follow-up to reduce false negatives. Brex also lets employees build their own AI stack (ChatGPT, Claude, Gemini) and runs agentic coding interviews internally, with the company growing 5X and cutting burn 99% in 18 months without adding engineers.

Artificial Analysis: The Independent LLM Analysis House — with George Cameron and Micah Hill-Smith

Jan 9, 2026 · 1:18:15

Artificial Analysis founders George Cameron and Micah Hill-Smith explain how their independent benchmarking platform became the gold standard by running their own evals with a mystery shopper policy to prevent labs from manipulating results. They launched in January 2024 after building it as a side project in Sydney, going viral after Swyx's retweet. The Intelligence Index V3 synthesizes 10 datasets with 95% confidence intervals, while the Omniscience Index measures hallucination rates from -100 to +100 (Claude models lead). Their GDP Val AA benchmark tests 44 white-collar tasks, and they open-sourced their agentic harness Stirrup. They also introduced an Openness Index scoring models out of 18 points. The episode covers how they make money through enterprise benchmarking subscriptions and custom work, and why the cost of GPT-4-level intelligence has dropped over 100× while total inference spend rises due to reasoning and agentic workflows.

[State of Context Engineering] Agentic RAG, Context Rot, MCP, Subagents — Nina Lopatina, Contextual

Dec 31, 2025 · 26:48

Nina Lopatina of Contextual AI discusses the state of context engineering, arguing that while the field is still in prototyping, 2025 will see true scale with full-system design patterns. She notes that agentic RAG—especially query reformulation into subqueries—has become the baseline, dramatically improving retrieval. Context rot is widely cited but industry benchmarks at real scale (100k+ documents, billions of tokens) remain rare. MCP is both a driver and a flaw: giant JSON tool definitions stuff the context window, yet MCP servers enable rapid prototyping before optimizing down to direct API calls. Sub-agents with turn limits are critical—unlimited agency degrades performance and causes hallucinations. Instruction-following re-rankers are essential for scaling retrieval across massive databases, providing more recall upfront and precision in the final context. Benchmarks are being saturated faster than ever: a Princeton benchmark from October was saturated by Claude Code in weeks, with solutions so good the gold dataset had errors. Lopatina also shares a lesson from using ChatGPT as a snowboarding coach—after several months of training for a 25-lap mogul race, she had to close…

[State of Evals] LMArena's $1.7B Vision — Anastasios Angelopoulos, LMArena

Dec 31, 2025 · 24:02

Anastasios Angelopoulos, founder of LMArena (now Arena), discusses the platform's $100M raise at a $1.7B valuation, its spin-out from Berkeley incubation by a16z's Anjney Midha, and its mission to be the industry's north star for real-world AI evaluation. He defends against the 'leaderboard illusion' paper, citing factual errors and reaffirming that models cannot pay to be on or off the public leaderboard. Arena funds inference costs for millions of monthly users, with 25% of its 5M+ users in software, and is expanding into occupational verticals (medicine, legal, creative) and multimodal video arenas. Key challenges include consumer retention, which improved with sign-in and persistent history, and moving off Gradio to React for better development. Angelopoulos calls for top talent in ML, product, and go-to-market to join the high-performance team.

[State of Post-Training] From GPT-4.1 to 5.1: RLVR, Agent & Token Efficiency — Josh McGrath, OpenAI

Dec 31, 2025 · 27:34

Josh McGrath, an OpenAI post-training researcher, states that real post-training innovation lies in data quality and signal trust, not optimization methods, with RLVR and token efficiency central. He moved from pre-training (3% compute gains) to post-training (40% behavior change), describes the infrastructure chaos of RL runs, and cites GRPO from DeepSeek Math as underappreciated for providing verifiable reward signals. GPT-5 to GPT-5.1 bumped evals while slashing tokens, emphasizing token efficiency over wall-clock time. The shopping model features interruptibility and chain-of-thought transparency, and personality toggles (Anton vs Clippy) are a key differentiator. For long context, he argues agents with graph walks may be more important than 10M-token windows. He concludes that the education system fails to produce people skilled in both distributed systems and ML research, a critical combination as bottlenecks shift.

[State of RL/Reasoning] IMO/IOI Gold, OpenAI o3/GPT-5, and Cursor Composer — Ashvin Nair, Cursor

Dec 30, 2025 · 45:13

Ashvin Nair, now ML lead at Cursor, traces his path from Berkeley robotics and an OpenAI Dota-era internship to OpenAI's reasoning team (which grew from a dozen to 300+ people) and explains why IOI Gold in 2022 felt like solving AI but didn't change the world—because RL doesn't generalize beyond training distribution. He argues most RL research from 2017-2022 overfit to benchmarks, rewarding complex ideas over simple ones that scale. At Cursor, he sees a unique opportunity for continual learning with policy updates every two hours and product-model co-design, keeping engineers in the loop instead of context-switching. His bet is that the next paradigm shift is continual learning with infinite memory: models experience something once and never forget it, storing millions of deployment tokens in weights without overloading capacity.

One Year of MCP — with David Soria Parria and AAIF leads from OpenAI, Goose, Linux Foundation

Dec 28, 2025 · 1:39:19

David Soria Parra, MCP lead at Anthropic, along with Jim Zemlin (Linux Foundation CEO), Nick Cooper (OpenAI), and Brad Howes (Block/Goose), recount the one-year evolution of the Model Context Protocol from a local experiment to the de facto standard for agentic systems, now donated to the new Agentic AI Foundation. They detail four spec releases—from local stdio to remote HTTP streaming, OAuth 2.1 authentication (and enterprise lessons learned), long-running tasks, and MCP Apps (iframes for richer UI)—and explain why internal enterprise adoption is exploding faster than expected, mostly invisible and at massive scale. The group reveals how three competitive AI labs came together to donate protocols and agents to a neutral foundation, how the foundation will balance taste-making (curating meaningful projects) with openness, and their 2025 vision: MCP as the communication layer for asynchronous, long-running agents that discover and install their own tools, unlocking another order of magnitude in AI productivity.

Steve Yegge's Vibe Coding Manifesto: Why Claude Code Isn't It & What Comes After the IDE

Dec 26, 2025 · 37:25

Steve Yegge argues that vibe coding—using multi-agent AI workflows—will replace traditional IDEs by January 1, calling anyone still using an IDE a 'bad engineer.' He claims Claude Code, Cursor, and the 2024 stack are already obsolete, predicting agent orchestration dashboards (like his VC project) will manage fleets of agents. Yegge highlights that senior engineers with 12–15 years of experience are the most resistant, but their productivity will be eclipsed by vibe coders. He warns that merging code becomes a new wall as agents produce 10x more code, citing one company's solution of one engineer per repo. Yegge also notes the chaos inside AI labs (OpenAI, Anthropic, Google) as they scale, and believes open‑source models will approach frontier capability within a year.

The Great Evals Debate — Ankur Goyal & Malte Ubl

Dec 7, 2025 · 34:33

Ankur Goyal (Braintrust) and Malte Ubl (Vercel) debate whether offline evals are essential infrastructure or premature optimization for AI coding agents, arguing that the best teams deliberately invest in multiple feedback loops—offline evals, A/B tests, and vibe checks—to build effective AI products. They explain that modern evals are not about manufacturing golden datasets but pulling real user failures from production logs into eval suites to iterate faster. The conversation highlights how evals provide a 'first derivative' that enables aggressive shipping without regression fears, akin to unit tests in traditional software. Coding evals are uniquely verifiable (e.g., 'does it compile?') yet underutilized; Vercel uses them in RL pipelines to fine-tune models that fix trivial errors 100x faster than agentic loops. They also discuss how product managers encode domain expertise through rubrics and LLM-as-judge scoring, and why proprietary evals are competitive moats while public benchmarks serve marketing. The debate concludes that RL environments are a promising frontier for computer-use agents but require specialized expertise to avoid reward hacking.

⚡️ Building the AI Hardware Engineer with Matthias Wagner, Co-founder of Flux

Nov 22, 2025 · 49:03

Matthias Wagner, CEO of Flux.ai, describes building the "AI hardware engineer" that turns product briefs into manufacturable PCB designs in under 30 minutes. After leaving Meta in 2019, Wagner built a browser-based collaborative CAD tool from scratch, designed as a reinforcement learning environment. The emergence of LLMs and reliable tool calling let Flux's agents search component libraries, check pricing and availability, and execute complex designs autonomously. In a live demo, Wagner designs a battery-powered Alexa-like device with ESP32, microphones, OLED display, and speaker in about 25 minutes. Flux now has 7,000 paying customers, growing 26x year over year, and Wagner envisions eventually letting users prompt full hardware products like smartphones into existence, claiming the cost of custom manufacturing is plummeting.

⚡️ 10x AI Engineers with $1m Salaries — Alex Lieberman & Arman Hezarkhani, Tenex

Nov 19, 2025 · 27:11

Tenex co-founders Alex Lieberman and Arman Hezarkhani explain how they compensate AI engineers by story points instead of hours, enabling some to earn over $1 million annually while delivering 10x productivity gains. The model emerged after Arman downsized his previous company Parthian's engineering team by 90% yet saw a 10x increase in production-ready software output by re-architecting with AI. They avoid gaming by hiring engineers who are long-term selfish or love coding, and pair them with technical strategists incentivized on account retention. Example projects include building a retail camera prototype in two weeks and a trivia app that hit #20 on the App Store in a month. Their default stack is TypeScript with React and Express, and they switch between coding agents like Claude Code and Codex based on daily performance. They identify human capital as their main constraint and context engineering or entropy reduction as the core challenge for autonomous AI engineers.

Anthropic, Glean & OpenRouter: How AI Moats Are Built with Deedy Das of Menlo Ventures

Nov 14, 2025 · 1:26:59

Deedy Das of Menlo Ventures returns to explain how Anthropic became the fastest-growing software company ever (zero to billions in revenue) and why Glean’s boring enterprise search moat of hard integrations and ranking problems is harder than competitors think. He reveals the $100M Anthology Fund’s strategy: backing OpenRouter, Goodfire, Prime Intellect, and Whisper—companies that solve thorny infrastructure or research problems rather than chasing apps. Das argues that model-layer companies will capture most value because building great models is harder than building apps, and that Anthropic’s product innovations like Claude Code emerge from a culture that lets researchers experiment freely. He also warns that vibe coding is becoming a cognitive crutch for engineers, eroding deep problem-solving skills, and discusses how enterprise AI market share has shifted dramatically: OpenAI went from 50% to 20%, while Anthropic rose from 12% to 32% of enterprise LLM API spend.

⚡ Inside GitHub’s AI Revolution: Jared Palmer Reveals Agent HQ & The Future of Coding Agents

Nov 10, 2025 · 35:52

Jared Palmer, SVP at GitHub and VP at CoreAI at Microsoft, traces his journey from building v0 at Vercel—a focused Next.js coding agent that grew from $1M ARR to millions more after adding chat—to launching Agent HQ at GitHub Universe, a collaboration hub for developers and coding agents. He explains how v0's success came from laser-focus on one stack and framework, and how GitHub's 180M developers enable scaling agent-based workflows. Palmer discusses model strategy tradeoffs (composite vs. branded models), the challenge of repo setup and infrastructure reliability, and using coding agents for non-coding tasks like automating Excel workflows. He reveals Stacked Diffs as GitHub's top feature request, with active exploration after previous attempts, and outlines his vision for seamless AI integration across GitHub, VS Code, and Actions, including features like resolving merge conflicts with AI.

⚡ Inside Google Labs: Building The Gemini Coding Agent — Jed Borovik, Jules + AIE CODE Preview

Nov 10, 2025 · 43:53

Jed Borovik, Product Lead at Google Labs, explains how Google builds Jules, an autonomous coding agent that runs on its own VM for long-running tasks, challenging the assumption that agents should operate locally. He reveals that as Gemini models improved, Jules' scaffolding simplified, shifting from sub-agent patterns and embedding-based RAG to attention-based search. Borovik discusses context window management for sessions lasting up to 30 days with 2 million tokens, and argues that coding agents will increase demand for software engineers (Jevons paradox), not eliminate jobs. He calls for better specification tools beyond chat, such as multimodal input and interactive planning, to move beyond 'vibe coding' toward verifiable, reliable agentic workflows.

The Agents Economy Backbone - with Emily Glassberg Sands, Head of Data & AI at Stripe

Oct 30, 2025 · 1:37:13

Emily Glassberg Sands, Head of Data & AI at Stripe, explains how Stripe builds economic infrastructure for AI, processing 1.4% of global GDP. Stripe's domain-specific foundation model runs inline on the charge path, detecting card-testing attacks on large users with detection rates improving from 59% to 97%. The Agentic Commerce Protocol (ACP) with OpenAI creates a shared standard for businesses to expose products to AI agents, adopted by Walmart and Sam's Club. Stripe helps AI companies combat new fraud vectors like free trial and refund abuse, and launched token billing to let wrappers price based on real-time inference costs. Internally, 85% of Stripes use LLM tools daily, with code generation and merchant understanding as key use cases. Emily argues AI companies grow 2-3x faster than SaaS, are twice as global, and that agentic commerce will expand consumption by removing time constraints for high-income consumers.

DevDay 2025: Apps SDK, Agent Kit, MCP, Codex and why Prompting is More Important than Ever

Oct 7, 2025 · 44:52

Sherwin Wu and Christina Huang from OpenAI's platform team discuss the new AgentKit suite and Apps SDK, arguing that visual agent builders and prompt optimization remain critical for production AI. They detail AgentKit's components—Agent SDK, visual Builder, Evals, and Tool Registry—and how Apps SDK inverts the website-chatbot paradigm by embedding apps inside ChatGPT. OpenAI adopted Anthropic's MCP protocol for tool connectivity, and the team dogfoods these tools for their own customer support at openai.com. They explain that automated prompt optimization and evaluation pipelines are essential for scaling agents, and share how Codex is used internally for code generation and PR reviews. The episode also covers the Service Health Dashboard for real-time API SLO tracking, reflecting OpenAI's reliability investments.

The antidote to AI fatigue — Answer.ai Solveit

Oct 2, 2025 · 55:26

Jeremy Howard, Eric Ries, and Johno Whitaker join host Alessio to present Answer.ai's Solveit platform, arguing that human-in-the-loop, step-by-step AI collaboration outperforms fully autonomous agents for complex coding and writing tasks. The 12-person team built their own integrated development and deployment system, eschewing cloud vendors. Solveit provides each user a persistent Linux Docker container with a Jupyter-like interface where the AI can see all steps, enabling immediate error correction and iterative improvement. Johno demonstrates building a perfume scent search engine in under an hour; Eric shows how he uses Solveit to manage writing his book 'Incorruptible', incorporating test reader comments and fact-checking sections. Jeremy reveals they turned Andrej Karpathy's GPT tokenizer video into a polished blog post. The Solveit course launches October 20th at solve.it.com, teaching this philosophy beyond just the tool.

⚡️Raising $1.1b to build the fastest LLM Chips on Earth — Andrew Feldman, Cerebras

Oct 1, 2025 · 29:14

Andrew Feldman, CEO of Cerebras, joins Latent Space to discuss their $1.1B fundraise at an $8.1B valuation and their wafer-scale chip that delivers 20x faster inference than NVIDIA's B200 GPUs. He explains how their architecture uses SRAM instead of HBM, providing 2,625x more memory bandwidth by eliminating the narrow straw between compute and memory. Feldman details the decision to accelerate sparse linear algebra rather than specialized convolutions, enabling support for transformers and diffusion models unseen during design. He discusses the explosive growth in AI inference demand, the shift from closed-source to fast open-source models, and the importance of speed—citing Paul Graham's observation that ChatGPT's slowness drives users away. The conversation covers enterprise trends in the 10-30B parameter space, the complexity of building data centers that pull gigawatts of power, and the often-overlooked routing and caching systems that make AI work seamlessly.

⚡️Snowglobe: Simulations for your AI

Sep 25, 2025 · 26:14

Shreya Rajpal returns to Latent Space to launch Snowglobe, a simulation engine that lets developers test AI products by generating diverse simulated user interactions before production, inspired by self-driving car simulation where Waymo logged 20 billion simulated miles versus 20 million real miles. She explains how simulation uncovers failures like over-refusal—a problem that emerged for a design partner who initially worried about toxicity—by generating personas with varied styles and goals. Snowglobe uses a multi-model architecture (proprietary and open source) to create realistic, diverse conversations, and it supports testing across chat, voice, and tool-calling agents. Pricing is usage-based per message, with persona modeling included. Shreya highlights enterprise use cases, such as comparing vendors or generating training data for fine-tuning, and notes the company is hiring a product designer, product engineer, and research staff.

⚡️No, Don't Do Palantir for AI - Brendan Falk, Hercules (AUDIO FIXED)

Sep 18, 2025 · 35:08

Brendan Falk, founder of Zeus (now Hercules), explains why he abandoned his vision to become 'Palantir for AI' after six months of enterprise AI transformations. Targeting Global 2000 companies with $5–10M contracts, he found that each use case required custom development, messy data, and high ongoing maintenance, with work scaling poorly across contract sizes. He also faced existential threats from specialized vendors like Decagon and Sierra, who could outspend and out-focus on single use cases. Falk pivoted to Hercules.app, an AI website builder that ships production apps, white-labeling payments and email. He argues the app builder market (Wix, Squarespace, Shopify) will expand with AI, and that brand and ease will sustain higher margins than developer tools like Cursor.

Long Live Context Engineering - with Jeff Huber of Chroma

Aug 19, 2025 · 57:01

Jeff Huber, founder and CEO of Chroma, joins Shawn Wang and Alessio to argue that context engineering—not RAG—is the real job of AI builders, and that Chroma's modern retrieval engine is built for this new paradigm. Huber explains context rot, a phenomenon where LLMs lose attention and reasoning ability as context windows grow, motivating precise retrieval over huge context windows. Chroma Cloud is a zero-config, usage-based serverless vector database with separation of storage and compute, now powering 5M monthly downloads and 21k GitHub stars. He shares techniques like chunk rewriting and generative benchmarking for evaluating retrieval, and predicts LLMs will increasingly serve as re-rankers. The episode also covers memory as a benefit of context engineering, offline compaction for self-improving AI systems, and Huber's philosophy of building with long-term purpose, hiring engineers who care about Rust, TLA+, and deterministic simulation testing.

⚡️Accelerators @ 3x NVIDIA H200 perf, Made in the USA - Thomas Sohmers + Mitesh Agrawal, Positron AI

Aug 18, 2025 · 47:56

Thomas Sohmers and Mitesh Agrawal of Positron AI argue memory bandwidth, not compute, is the true bottleneck in AI inference, and their accelerator achieves 93% memory bandwidth utilization—triple NVIDIA's efficiency—enabling 70% faster token generation at 150W. The founders, both Lambda Labs veterans, shipped an FPGA product 15 months after founding, then raised a $51M Series A for an ASIC in late 2026. Their hardware requires no recompilation: it ingests raw binary weights from NVIDIA training and outputs an OpenAI-compatible API. Positron focuses on the decode phase of transformers, where memory-bound matrix-vector multiplication dominates, and already counts Cloudflare and Parasail as customers. The company sells systems directly, prioritizing capital efficiency and ROIC over operating its own cloud.

The AI Agenda: GPT5 leaks and the business of AI News — Steph Palazzolo, The Information

Aug 6, 2025 · 1:14:36

Steph Palazzolo, AI journalist at The Information, explains how she covers the secretive AI industry, from OpenAI's GPT-5 to the inference market where startups like Modal raise billions. She reveals that inference providers are essentially GPU resellers facing margin pressure, and that GPT-5's performance will signal whether pre-training scaling or reinforcement learning drives progress. She critiques Meta's super intelligence ambition as misaligned with its ad-revenue business, and details the talent war with rumored hundred-million-dollar offers from Meta to poach researchers. Palazzolo also discusses the Windsurf acqui-hire backlash, the rise of coding agents like Claude Code, and how journalists protect sources while navigating leaks from CEOs like Sam Altman.

⚡️Composio: 10,000+ tools that evolve for Agents — Karan Vaidya and Soham Ganatra

Aug 4, 2025 · 22:09

Composio co-founders Karan Vaidya and Soham Ganatra join Swyx and Alessio to discuss their platform for self-evolving agent skills, now with 25,000+ actions and 100,000+ developers. They explain how MCP's client-side limitations led them to build a learning infrastructure that analyzes agent usage patterns to improve tool reliability over time. The team uses agents to build and maintain 95% of their 500+ integrations, adding 35 per week, with plans for 5,000 by year-end. They reveal that more than 20-25 actions confuse LLMs, so they offer a natural-language execution tool and dynamic tool exposure via MCP. Key challenges include enterprise APIs with poor documentation and the need for dev environments. Composio's internal agent benchmarks and A/B testing infrastructure optimize tool schemas for LLM calling.

AI is Eating Search

Jul 23, 2025 · 56:22

Robert McCloy of Scrunch AI argues that AI is replacing web browsing, not just search, as consumers prefer ChatGPT and similar tools over traditional browsing. He explains that AI search platforms still rely on traditional search under the hood, but re-rank results based on metadata clarity—so clickbait titles fail while descriptive content wins. Prompt injection works currently but is a temporary tactic; the durable strategy is clear, structured content with server-side rendered HTML because AI tools don't execute JavaScript. Scrunch helps brands optimize for platforms like ChatGPT, Perplexity, and Meta AI; customer Clerk saw a 6x traffic increase and 9x conversion lift from AI-referred visitors. Robert predicts the future is about 'agent experience'—optimizing how AI systems interact with your content to serve end users directly.

Personalized AI Language Education — with Andrew Hsu, Speak

Jul 11, 2025 · 1:04:10

Andrew Hsu, CTO of Speak, explains how the company built the "third generation" of language learning by betting on AI speech and language models before they were ready. Speak focused on South Korea early, a counterintuitive move for a San Francisco startup, and now 6% of the Korean population has tried the app. The turning point came with Whisper and GPT in 2022, which enabled Speak to evolve from a listen-and-repeat tool into a full-featured AI tutor that gives real-time feedback and adapts to learners. Speak generates over $50M ARR primarily from consumer subscriptions, and Hsu details the product decisions that made it work: abandoning a free version, building custom ASR for low latency, and emphasizing functional fluency over textbook language. He also reveals that Speak is building a real-time voice platform and a knowledge graph for personalized fluency scores, with an eye toward expanding beyond language into general AI-powered education.

Information Theory for Language Models: Jack Morris

Jul 2, 2025 · 1:18:13

Jack Morris, a Cornell PhD student advised by Sasha Rush, discusses his information-theoretic research on language models, including embedding inversion (recovering text from embeddings with 90% accuracy), the universal geometry of embeddings (aligning different models' latent spaces), and measuring model memorization capacity at 3.6 bits per parameter. He argues that paradigm shifts in AI, from AlexNet to instruction tuning, stem not from new architectures but from new datasets, and that the next breakthrough will likely emerge from a novel data source. The conversation also covers the shift from academia to industry, practical advice for grad students on distributed training, and the implications of embedding inversion for privacy and model alignment.

⚡️Warp 2.0: the Agentic Development Environment - Zach Lloyd and Ben Holmes

Jun 25, 2025 · 52:23

Warp CEO Zach Lloyd and engineer Ben Holmes debut Warp 2.0, rebranding from an AI terminal to an Agentic Development Environment (ADE) with a state-of-the-art coding agent that rivals Claude Code and Cursor. The episode demonstrates Warp's new universal input that auto-detects English commands and terminal input, voice-driven agent workflows, multi-threaded agents running in tabs, inline diff editing, MCP support, and REPL translations for SQL and Postgres. Lloyd explains the design philosophy of keeping a terminal-like UX while adding agent management features, and discusses pricing changes (Pro now 2,500 requests, Turbo 10,000, plus usage-based credits) and the challenge of subscription vs. usage-based models. Warp has nearly 600,000 active users with weekly revenue growth of 5–15%, and the team positions itself as a model-agnostic layer above Anthropic, Google, and OpenAI, offering deeper integration than ChatGPT or Claude desktop apps.

Scaling Test Time Compute to Multi-Agent Civilizations — Noam Brown, OpenAI

Jun 19, 2025 · 1:17:47

Noam Brown, OpenAI researcher behind Cicero and reasoning models, joins hosts Alessio and Puix to discuss how test-time compute scaling drives multi-agent AI and the limits of the system 1/2 analogy. He explains that his Diplomacy bot Cicero reached top 10% of humans in 2022, and later he won the 2025 world championship. Brown argues that reasoning models like o3 succeed in unverifiable domains (e.g., Deep Research) and that harnesses and routers will be washed away by scale. He reveals OpenAI's multi-agent team is pursuing a principled approach, not heuristic, and envisions AI civilizations collaborating. He also shares his coding stack (Codex, Windsurf) and predicts test-time compute will hit cost and wall-clock bottlenecks.

Quadratic: The AI Spreadsheet

Jun 10, 2025 · 28:15

David Kircos, co-founder and CEO of Quadratic, joins hosts Alessio and Swyx to demonstrate Quadratic, an AI-powered spreadsheet that natively executes Python, JavaScript, and database queries in WebAssembly for real-time performance. The product's AI assistant uses a context-aware agent loop that summarizes sheet structure rather than dumping full data, then tool-calls to read columns or peek at values only when needed, keeping costs low on large datasets. Kircos explains Quadratic's three-year technical groundwork—WebGL rendering and WebAssembly runtimes—enabled them to capitalize on AI, turning a 'technical spreadsheet' into one where users simply drop a CSV and say 'help me analyze this.' He details how they route chart images back to the model for visual feedback and predicts that formulas will yield to Python for complex analysis, though spreadsheets will remain the best interface for human–AI data collaboration. Quadratic is source-available on GitHub, supports real-time multiplayer, and has grown to nine people. The episode also covers future directions like proactive agents and form controls (sliders) for interactive models.

ChatGPT Codex: The Missing Manual

May 16, 2025 · 53:32

Josh Ma and Alexander Embiricos from OpenAI introduce ChatGPT Codex, a cloud-hosted autonomous software engineer that runs in its own sandbox, arguing it delivers value through single-shot, long-horizon task completion. They explain that Codex evolved from internal experiments (codenamed WHAM) and now offers a 60-tasks-per-hour rate limit with a one-hour hard cutoff, emphasizing it is not meant for interactive use but for delegation—users fire off tasks and go about their day. Best practices include using agents.md, installing linters and formatters, keeping code modular, and having good architecture. The team intentionally kept it a research preview to gather feedback on environment customization and pricing, with plans to integrate seamless transitions between cloud and CLI.

Voice AI Masterclass — Kwindla Hultman Kramer and swyx

May 6, 2025 · 20:51

Shawn Wang and Kwindla Hultman Kramer announce a voice AI masterclass course, diving into the landscape of models like Dia and Parakeet, production deployment challenges, and future trends such as speech-to-speech and real-time video. Kwindla explains that telephony (Twilio) drives 99% of current monetizable voice AI, while open source frameworks like Pipecat enable low-latency multi-modal apps. The course covers turn detection, context management, and evals, with 28 sessions featuring partners like OpenAI, Google, and NVIDIA. The goal is to jumpstart builders from prototype to production, with real-time video expected to hit its inflection point by year-end.

Tiny Teams: $6m ARR, 5m users with 4 employees — Sid Bendre, Oleve (Quizard AI/Unstuck AI)

Apr 23, 2025 · 42:59

Sid Bendre of Oleve (formerly Quizzer AI and Unstuck AI) explains how his four-person team built $6M ARR and 5M users across multiple consumer apps. Starting with Quizzer AI in January 2023, a viral TikTok gained 10K users in 30 hours; by August 2024, Unstuck AI hit 1M users in nine weeks. The company has been profitable since its first nine months. Bendre describes their platform engineering strategy: product engineers own individual apps while a platform team builds reusable systems, including internal shadow-org agents for growth and marketing. He shares technical hacks like using LaunchDarkly feature flags to load-balance across Azure OpenAI endpoints and a de-indexer for Azure AI Search to manage costs. The key engineering principle is deterministic LLM workflows—classifying user intent then routing to pre-built deterministic flows—rather than open-ended agent tool use.

Sleep-Time Compute — Letta AI (Charles Packer, Charlie Snell, Kevin Lin)

Apr 21, 2025 · 34:02

This episode covers Letta AI's new paper on Sleep-Time Compute, a scaling direction that applies compute during model idle periods (sleep time) rather than only at test time. Charles Packer, Kevin Lin, and Charlie Snell explain that sleep-time compute precomputes inferences from static context before queries arrive, yielding Pareto improvements on math benchmarks like GSM8K by shifting the accuracy-to-token curve leftwards. They distinguish it from test-time compute by emphasizing that sleep-time tokens incur no user-latency cost, and show that the benefit is largest when questions are predictable from context. The team also ties the concept to stateful agents and memory systems (building on MemGPT), releasing two implementations: one for low-latency chatbots and another for document-driven agents.

The Rise and Fall of the Vector DB category: Jo Kristian Bergum (ex-Chief Scientist, Vespa)

Apr 19, 2025 · 27:17

Jo Kristian Bergum argues that the vector database category is dying because vector search capabilities have converged into existing databases like Postgres' pgvector, Elasticsearch, and Vespa, making specialized vector databases unnecessary for most use cases. He traces the category's rapid rise after ChatGPT, driven by the misconception that RAG required embeddings, and notes Pinecone's high ARR and subsequent repositioning. Bergum emphasizes that embeddings remain important but should be combined with traditional retrieval methods like BM25 for effective search, and that re-ranking can add modest gains. He critiques the hype around knowledge graphs, noting the bottleneck of building them, but sees LLMs making triplet generation easier. For the future, he hopes for more domain-specific embedding models and visual language model backbones, though acknowledges the difficulty of the business model.

GPT 4.1: The New OpenAI Workhorse

Apr 15, 2025 · 45:04

OpenAI's Michelle Pokrass and Josh McGrath join hosts Alessio, Swyx, and Sean to launch GPT 4.1, a new model family positioned as the go-to workhorse for developers with major improvements in coding, instruction following, and long context. The three models—4.1, 4.1 Mini, and 4.1 Nano—introduce a 1M-token context window, 75% prompt caching discount, and cheaper pricing than 4o. Coding gains are highlighted by 55% on SWE-bench (vs o1's 41%), while instruction following benefits from real-world API data and new evals like GraphWalk for multi-hop reasoning. The team explains that most improvements come from post-training techniques, with vision capabilities lifted by a new pre-trained base. Fine-tuning is available day one, and developers are encouraged to opt in to data sharing for future model iterations.

The Agent Network — Dharmesh Shah, Agent.ai + CTO of HubSpot

Mar 28, 2025 · 1:42:28

Dharmesh Shah, founder of Agent.ai and co-founder of HubSpot, defines an AI agent broadly as AI-powered software that accomplishes a goal, and argues that the next frontier is multi-agent systems and shared memory across agents. He reveals Agent.ai has 1.3M users and 3,000 published agents, positioning it as a professional network where agents have profiles, post release notes, and can be composed via MCP servers. Shah contrasts work as a service (paying for the work done) versus results as a service (paying for outcomes), warning that results-based pricing only works for objectively measurable, low-variance tasks like customer support tickets. He advocates for MCP as the standard for agent-tool discovery, and shares his personal engineering philosophy of preferring under-engineering over over-engineering because the cost to fix later trends toward zero with AI code generation. Shah also discusses his domain investing strategy (owning chat.com, prompt.com, crew.ai), his rule against competing with Sam Altman, and the 'Sorry Must Pass' framework for managing overwhelm by defaulting to no.

Building Manus AI (first ever Manus Meetup)

Mar 27, 2025 · 48:59

Tao Zhang, co-founder of Manus, explains how Manus gives LLMs 'hands' to take real-world actions, inspired by MIT's 'mens et manus' (mind and hand). Manus assigns each task its own cloud virtual machine via E2B, provides pre-paid data APIs (stock, social media), and a knowledge system to remember user preferences. Their previous product, Monica.im, grew to 20M monthly active users and $50M ARR before they pivoted from a failed AI browser project to Manus. On the GAIA benchmark, Manus achieves a per-task cost of ~$2, far cheaper than OpenAI's Deep Research (~$20) and prior SOTA. Zhang emphasizes a 'less structure, more intelligence' philosophy, opting not to predefine workflows but to give the model rich context and tools. He also discusses plans to partner with Cloudflare, pay paywalls on behalf of users, and integrate more APIs based on usage patterns, while ruling out building their own foundation model.

Solve coding, solve AGI [Reflection.ai launch w/ CEO Misha Laskin]

Mar 7, 2025 · 28:12

Misha Laskin of Reflection AI argues that solving autonomous coding is the direct path to AGI, combining reinforcement learning (pioneered by his team on AlphaGo/AlphaZero) with large language models (which they advanced at Google on PaLM, Gemini, ChatGPT). He explains that coding is already ergonomic for LLMs—unlike browser agents that require noisy human mouse data—making it the ideal starting point. Reflection AI is building coding agents that automate backlog tasks (testing, refactoring, migrations, security remediation) for large engineering teams, delivering them via an API that takes a task and codebase and outputs resolved code. Laskin insists superintelligence cannot be built in a vacuum; real-world customer evals are essential, as benchmarks like SWE-bench don't guarantee production reliability. He also stresses the need for open-weight models to prevent a few companies from hoarding superintelligent coding agents.

S1: the $6 DeepSeek R1 Competitor (ft. Entropix)

Feb 26, 2025 · 17:43

Tim Kellogg joins hosts Alessio and Swyx to break down his viral blog post on S1, showing how Stanford researchers cloned DeepSeek R1's reasoning for $6 by inserting a 'think token' and fine-tuning on just 1,000 examples. Kellogg argues the real innovation isn't the cost but the technique's simplicity—making advanced inference-time scaling accessible. He explains Entropix, a dynamic sampler that uses model entropy and varentropy to adjust generation on the fly, and notes its creators are starting a company. The conversation contrasts supervised fine-tuning's targeted results with RL's broader reasoning growth, using an analogy: 'RL causes a lot of growth, then SFT trims it.' Kellogg predicts that embedding introspection signals into RL training could solve agent 'doom loops' and unlock higher agency—a key challenge behind products like OpenAI's Deep Research.

The AI Architect: Bret Taylor

Feb 11, 2025 · 1:35:59

Bret Taylor, CEO of Sierra and chairman of OpenAI, recounts engineering AI's future across three eras — rewriting Google Maps' frontend in a weekend (cutting un-gzipped code to 20K), building Sierra's in-house agent platform for consumer brands like Sonos and SiriusXM, and navigating OpenAI's leadership crisis. He argues that AI agents' core abstractions are still pre-React, compares today's agents to jQuery, and predicts that outcome-based pricing will dominate as agents complete jobs rather than assist humans. He urges software engineers to move up the stack toward domain-specific agents and to embrace Rust-like languages for AI-generated code, emphasizing formal verification and safety. Taylor also shares how OpenAI prioritizes mission over product features, and why the relationship with Microsoft remains OpenAI's most important partnership.

OpenAI o1 isn’t a chat model (and that’s the point)

Jan 17, 2025 · 31:59

Ben Hylak and Dan McAteer explain why OpenAI’s o1 is not a chat model and how mastering its prompting turned Ben from a skeptic into a proponent. Ben’s prompt structure—goal, return format, warnings, context dump—emphasizes describing what you want rather than how to think, a shift from earlier models. Dan uses o1 for coding by feeding it full code context, achieving one-shot implementations that reach 100% where previous models maxed out at 95%. Ben notes o1 is the most capable but hardest model to use, with experiments costing $20 per try, and argues model routing will let humans or systems trade off cost, speed, and intelligence. Dan also applies o1 to scientific research, feeding it papers from multiple fields to find novel connections that humans would miss.

Beating Google at Search with Neural PageRank and $5M of H200s — with Will Bryk of Exa.ai

Jan 10, 2025 · 55:54

Will Bryk, CEO of Exa.ai (formerly Metaphor), details building a neural search engine from scratch using link prediction as 'Neural PageRank' — predicting documents rather than keywords. Exa's new product offers near-perfect lists (e.g., 'startups working on hardware in SF') by scaling compute per query, from milliseconds to a day, like o1 for search. Bryk argues LLMs will become the interface to search, while Exa provides the 'super knowledge' that even AGI will need. He contrasts Exa's neural approach with Google's keyword-based system and Perplexity's reliance on Bing. The company recently purchased a $5M H200 cluster and maintains a culture of nap pods and first-principles thinking.

The State of Reasoning — from Nathan Lambert, Interconnects/AI2 [LS Live @ NeurIPS 2024]

Jan 2, 2025 · 16:22

Nathan Lambert argues that language models do perform reasoning, contrary to skeptics, and that embracing chain-of-thought and reinforcement learning (RL) is key to advancing their capabilities. He explains OpenAI's o1 as large-scale RL on verifiable outcomes, noting that post-training flops exceed pre-training, and highlights relatives like DeepSeek and Qwen which are narrower. Lambert details OpenAI's new reinforcement fine-tuning API, which uses the same infrastructure as o1 and requires only dozens of labeled samples, and contrasts it with process reward models or Monte Carlo tree search. He presents his own project using RL on math evaluations (GSM8K, MATH, AFeval) to show gentle RL fine-tuning can boost specific capabilities without degrading general performance. The talk concludes that reasoning is worth pursuing and that new, less-human-like forms of model reasoning are emerging.

2024 Year in Review: The Big Scaling Debate, the Four Wars of AI, Top Themes and the Rise of Agents

Jan 1, 2025 · 1:51:07

In their 100th episode, hosts Alessio and Swyx recap 2024 in AI, arguing that pre-training scaling has hit a wall—backed by Ilya Sutskever and others at NeurIPS—and that inference-time compute (o1, o3) is the new frontier. They dissect the "four wars": data quality (lawsuits vs. synthetic data), GPU haves vs. have-nots (with the middle class dying), multimodality (Sora, Veo 2, Gemini 2.0's native image output), and the LLM OS/agents stack (LangChain, E2B, memory). Market share shifted from OpenAI's 95% to 50-75% as Anthropic and Gemini gained ground; prices dropped ~3 orders of magnitude for same ELO. The episode predicts 2025 as the year agents finally enter production, driven by models like o1 and tools like Devin, and warns that AI will set the skill floor for roles.

The State of AI Startups in 2024 [LS Live @ NeurIPS]

Dec 21, 2024 · 26:35

Sarah Guo and Pranav Reddy argue that 2024 has become a far friendlier ecosystem for AI startups, with the model landscape shifting from OpenAI's near-monopoly to a competitive field where Google's Gemini now leads LMSys Arena and open-source models like Llama 8B score ten points higher on MMLU than Mistral 7B a year ago. They note that OpenAI's API cost has dropped 80-85% in 18 months, and total OpenAI API share fell from ~90% to ~60% as customers switch. The funding environment is rational, not a bubble, with foundation-model labs raising $30-40B but most startups seeing sane valuations; one portfolio company grew from zero to twenty million in PLG-style spending. Key startup themes include first-wave service automation (Sierra, Decagon, Harvey, EvenUp), better search and new friends (Perplexity, Glean, Character, Replica), and democratized creativity (Midjourney, HeyGen). They argue the 'GPT wrapper' narrative is false—applications capture value—and that incumbents face innovator's dilemma because AI changes business models (outcomes-based pricing) and data needs (reasoning traces rarely saved). The speed of change and new markets (legal, healthcare, defense) structurally favor…

Windsurf: The Enterprise AI IDE

Dec 13, 2024 · 1:06:36

Varun Mohan and Anshul of Codeium explain why they built Windsurf, a new AI IDE, arguing that VS Code's API limitations prevented them from delivering the best agentic experience. They detail how Cascade, their agentic system, uses proprietary retrieval and planning models alongside third-party LLMs, and describe their evaluation method that masks commits and tests incomplete code states. The duo also reveals that over 800,000 developers use Codeium extensions, that they still support JetBrains and Eclipse for enterprise customers, and that they intentionally avoided a waitlist launch. They discuss the trade-offs of building first-party vs. third-party models, the importance of 'go slow to go fast' in enterprise infrastructure, and their belief that individual developer profits should come after building switching costs through superior product.

In the Arena: How LMSys changed LLM Benchmarking Forever

Nov 1, 2024 · 41:02

Anastasios and Weilin from LM-Sys explain how ChatBot Arena became the de facto standard for LLM benchmarking by replacing static benchmarks with dynamic human preference evaluations. They trace the origin from Vicuna fine-tuning to the viral launch in April 2023, where anonymous side-by-side battles let the community decide which model is better. To address biases like length preference, they developed Style Control, a logistic regression method that adjusts for confounders such as response length and markdown formatting. They address the controversy around labs testing multiple private models, arguing that selection bias is empirically small and the live benchmark self-corrects over time. They also discuss RouteLLM for cost-performance routing, the graduation of ChatBot Arena from LMSys to support new projects, and call for community help with red teaming, vision modalities, and implementing a REPL for coding evaluations.

How NotebookLM Was Made

Oct 25, 2024 · 1:13:57

Raiza Martin (NotebookLM lead PM) and Usama Bin Shafqat (AI engineer) explain how Google's NotebookLM built the viral 'Deep Dive' audio overview feature. They reveal the product evolved from Project Tailwind, using Gemini 1.5's long context and DeepMind speech to create a two-persona dialogue format that transforms documents into engaging podcasts. The team learned from 65,000 Discord members, leaned on best-selling author Steven Johnson for a 'tool for thought' workflow, and prioritized a single format over exposed controls to preserve unpredictability and delight. Humor and tension are not explicitly prompted but emerge from giving personas different angles. Evaulation relied on internal taste ('potatoes for chefs') before formal raters, with a Likert scale on dimensions like entertainment and groundedness. Future plans include multilingual support, API access, real-time chat, and codebase podcasting, while managing non-determinism by accepting occasional bad rolls.

Building the Silicon Brain - Drew Houston of Dropbox

Oct 18, 2024 · 1:11:40

Drew Houston, CEO of Dropbox, details his hands-on AI engineering journey and the company's strategic pivot to AI-first products like Dropbox Dash for universal search and access control. Having spent over 400 hours coding with LLMs, he built personal tools that seeded Dropbox AI, including a file question-answering system. He advocates 'rent, don't buy' for AI infrastructure, relying on open-source models and keeping options open as costs drop 10-100x yearly. Houston explains Dropbox's advantage in trust and data privacy, positioning it as a neutral platform that integrates with Google Drive and OneDrive. He discusses staying relevant through constant learning and founder mode, and advises founders to systematically train skills ahead of their company's growth.

Production AI Engineering starts with Evals

Oct 11, 2024 · 1:56:16

Ankur Goyal, founder and CEO of Braintrust, argues that evaluation is the core workflow of production AI engineering and shows how his platform makes evals accessible to software engineers. Drawing from his experience at SingleStore and Impira, he details Braintrust's evolution from an eval tool into an end-to-end AI development platform used by Stripe, Zapier, Vercel, and other top AI teams. He shares market data: OpenAI handles over 95% of production workloads, fine-tuning is declining, and open-source models account for under 5% due to reliability issues. Ankur explains why he avoided building a vector database—the real challenge is permissions and joins, not vector search—and predicts o1-style reasoning will replace complex agent frameworks. He reveals Braintrust's differentiators: hybrid on-prem, TypeScript-first SDK, and declarative eval structures.

Building AGI in Real Time (OpenAI Dev Day 2024)

Oct 4, 2024 · 2:09:35

OpenAI's DevDay 2024 unveils the Realtime API with WebSocket-based voice and function calling, Vision Finetuning, Prompt Caching, and Model Distillation. Product leads Olivier Godement, Romain Huet, and Michelle Pokrass detail design choices like zero-code caching and WebSockets for human-level latency. Alistair Pullen of Cosine explains how fine-tuning GPT-4o on custom reasoning traces beat o1 on SWE-bench Verified, while Sam Altman and Kevin Weil discuss AGI levels (o1 as level 2 reasoner), the coming agent era (level 3), safety through iterative deployment, and the importance of building for the frontier. The episode also covers moderation policy relaxation, plans for o1 system prompts by year-end, and the competitive admiration for NotebookLM.

[Paper Club] Who Validates the Validators? Aligning LLM-Judges with Humans (w/ Eugene Yan)

Sep 28, 2024 · 1:00:55

Eugene Yan presents the paper 'Who Validates the Validators? Aligning LLM-Judges with Humans' by Shreya Shankar, introducing EvalGen, a framework that helps developers iteratively align LLM evaluators with human labels by grading outputs, refining criteria, and tracking coverage (recall) and false failure rate (1−precision). Yan demonstrates his own prototype 'Label', which forces users to label 20 samples before unlocking evaluation mode and 50 samples plus one evaluation run before optimization, gamifying the alignment loop. The discussion covers binary vs. pairwise evaluation, the subjectivity of criteria, and Shreya Shankar's plans to integrate natural language feedback into EvalGen's next version. Yan advocates that labeling data is essential before deploying LLM evaluators in production, turning the process into prompt fine-tuning rather than vibe checks.

The Ultimate Guide to Prompting - with Sander Schulhoff from LearnPrompting.org

Sep 20, 2024 · 1:07:09

Sander Schulhoff, author of The Prompt Report and founder of LearnPrompting, presents a comprehensive taxonomy of 58 prompting techniques and argues that prompt engineering is a skill everyone should have, not a specialized role. He categorizes techniques by problem-solving strategy (zero-shot, few-shot, thought generation, decomposition, ensembling, self-criticism) and debunks role prompting for accuracy-based tasks, showing an 'idiot' prompt outperformed a 'genius' prompt on MMLU. Schulhoff shares his experience running Hack-a-Prompt, which collected 600,000 malicious prompts and won best paper at EMNLP, and differentiates between prompt injection and jailbreaking. He advocates for automatic prompt engineering with DSPy, which beat his manual effort in 10 minutes, and previews Hack-a-Prompt 2.0, aiming for a $500,000 prize pool to generate real-world harms for safety tuning.

[Paper Club] 🍓 On Reasoning: Q-STaR and Friends!

Sep 18, 2024 · 47:12

This episode of Paper Club surveys three reasoning papers — STaR, Quiet-STaR, and V-STaR — arguing that while STaR is foundational for bootstrapping reasoning via rationales and rationalization, Quiet-STaR's attempt to generate rationales at every token yields only marginal gains (5–10% on GSM8K and CQA), and V-STaR's verifier trained with DPO on both correct and incorrect solutions delivers the most practical improvement, beating majority voting. The host explains STaR's two-loop process of generating rationales and rationalizations from wrong answers, highlights examples like a filtering-straw question where human raters evaluated reasoning quality, and notes that STaR on GPT-J 6B achieved human-like step counts in math problems. V-STaR's verifier selects among candidate solutions, scaling with K candidates, and is compared to process reward models from OpenAI's "let's verify step by step."

Building AGI with OpenAI's Structured Outputs API

Sep 17, 2024 · 1:12:23

Michelle, OpenAI's API tech lead, explains how the newly launched Structured Outputs feature achieves near-100% reliability for schema-following outputs by combining constrained decoding with model training, moving beyond the limitations of JSON mode and Function Calling. She details the refusal field that allows the model to decline harmful requests while maintaining parseable output, and discusses use cases like dynamic UI generation and mathematical chain-of-thought. The roadmap includes parallel function calling and custom grammars. The episode also covers the GA of GPT-4o fine-tuning, Batch API's 50% cost savings, Vision API integration with structured outputs, the Whisper API's surprising lack of diarization, and the shift toward speech-to-speech APIs. Michelle shares insights from her Waterloo co-op background and what qualities succeed at OpenAI: low ego, user-focused, and driven.

Personal benchmarks vs HumanEval - with Nicholas Carlini of DeepMind

Aug 28, 2024 · 1:07:28

Nicholas Carlini, a DeepMind research scientist, argues AI models are practically useful for personal tasks despite flaws, and personal benchmarks tailored to individual use cases matter more than generic leaderboards. He shares from his 'How I Use AI' post: using LLMs for ephemeral software, kickstarting Docker, debugging by pasting error messages. He built a personal benchmark DSL that runs code from real chat history. On security, he explains buying expired domains from LAION-400M allowed poisoning any model trained on it, and he extracted OpenAI's Ada and Babbage model dimensions via API (with permission). He also recovered training data from GPT-3.5 by repeating a word until ChatGPT output verbatim sequences. He prefers attacking over defending because it's more fun and essential for discovering real vulnerabilities.

Answer.ai & AI Magic with Jeremy Howard

Aug 17, 2024 · 1:11:00

Jeremy Howard of Answer.AI argues that continuous pre-training should be treated as a continuum, not separate phases, and demonstrates how FSDP+QLoRA enables training a 70B model on just two NVIDIA 4090s. He reveals Answer’s non-hierarchical, manager-free R&D lab model that recruited unusual talent like Benjamin Warner and Ben Claviez, who independently launched BERT 24 to revive encoder-only architectures. Howard introduces FastHTML, a pure-Python web framework built on HTMX and Starlette, for creating modern SPAs without JavaScript. He previews “AI Magic,” a dialogue engineering system that moves beyond teletype-style chat interfaces and code editors, aiming to make AI-assisted development more interactive. The episode also covers Answer’s Public Benefit Corporation structure designed to resist hostile takeovers, and critiques decoder-only hype while advocating for encoder-decoder and state-space models.

Segment Anything 2: Memory + Vision = Object Permanence — with Nikhila Ravi and Joseph Nelson

Aug 7, 2024 · 1:00:44

Nikhila Ravi from FAIR and Joseph Nelson from Roboflow discuss Segment Anything 2 (SAM 2), which extends zero-shot object segmentation to video with memory and real-time interactive tracking. The model is one-third the size of SAM 1 (224M vs 630M parameters) and six times faster, using a novel memory attention mechanism with six-frame spatial memory and longer-term object pointers. Ravi explains the three-phase data engine that built the SA-V dataset of 51,000 videos, enabling SAM 2 to track arbitrary objects like a T-shirt or an octopus even when occluded. At Roboflow, users labeled 49 million images with SAM in its first year, saving an estimated 35 years of manual annotation time. The demo features swim lanes that show object visibility and allow refinement clicks to correct tracking mistakes, a key improvement over prior video segmentation models. SAM 2 also handles out-of-distribution domains like underwater footage, though screenshots remain challenging and may require fine-tuning.

The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)

Aug 2, 2024 · 1:23:36

Swyx and Alessio recap Q2 2024 through their 'Four Wars' framework, arguing that the AI landscape is shifting from frontier model dominance to commoditization and vertical applications. They highlight Claude 3.5 Sonnet overtaking OpenAI on coding benchmarks, Llama 3.1's synthetic data approach enabling 7B models to rival GPT-4, Mistral Large 2's non-commercial license and lost open-source crown, and on-device models like Gemini Nano and Apple Intelligence. The Quality Data Wars see NYT suing OpenAI, Reddit licensing data for $200M+, and synthetic data proving real for math (AlphaProof near IMO gold) and code. The Multimodality War includes ChatGPT Voice Mode delayed, Meta's Chameleon for native fusion, and Google's PaliGemma for PDF extraction. The renamed LLM OS War covers agent protocols, memory databases, and the collapse of model cost by an order of magnitude every four months, pushing startups toward vertical services like Brightwave and Dropzone that sell labor, not tools. The episode ends with a CrowdStrike joke about agent safety.

[LLM Paper Club] Llama 3.1 Paper: The Llama Family of Models

Jul 29, 2024 · 1:23:46

This episode examines Meta's Llama 3.1 paper, detailing the 405B dense model, its scaling laws grounded on the ARC reasoning benchmark rather than perplexity, and the decision to train on 15 trillion tokens. Vibhu explains the training infrastructure: 16,000 H100s over 54 days with 419 interruptions, 78% from GPU hardware failures. Eugene Yan walks through the synthetic data pipeline—using Llama 2 for filtering, stepwise reward models, and Monte Carlo tree search to improve reasoning traces. Hassan shares building LlamaTutor.com with Together API, serving 4,000 visitors and 5,900 requests for about $12. The group also discusses quantization trade-offs (larger models degrade less), inference provider variability (Groq's non-deterministic temperature zero), and compares Llama 405B's performance to GPT-4o and Claude.

Training Llama 2, 3 & 4: The Path to Open Source AGI — with Thomas Scialom of Meta AI

Jul 23, 2024 · 1:04:34

Thomas Scialom, Llama 2 lead and Llama 3 post-training lead at Meta AI, explains why scaling laws must go beyond Chinchilla—training models longer on more tokens yields better inference efficiency than bigger models, a lesson that drove Llama 3's 15 trillion token pre-training. He details how synthetic data from Llama 2 bootstrapped Llama 3's post-training, eliminating human-written SFT data, and why RLHF outperforms imitation learning: humans are better discriminators than generators, enabling superhuman outputs. Scialom defends the dense 405B architecture over MoE, calls tokenizer vocab size underrated (128k tokens vs Llama 2's 32k), and reveals Llama 4's focus on agentic capabilities—tool use, multi-step reasoning—as the path to open-source AGI. Meta AI is hiring researchers with rigorous first-principles thinking.

This World Does Not Exist — Joscha Bach, Karan Malhotra, Rob Haisfield (WorldSim, WebSim, Liquid AI)

Apr 27, 2024 · 1:56:11

The episode features Karan Malhotra demoing WorldSim, a prompt that turns Claude 3 into a universe simulator via CLI; Rob Haisfield presenting WebSim, which generates functional websites on the fly; and Joscha Bach arguing simulative AI reveals consciousness as a virtual property, with LLMs creating agents as real as human minds, urging the California Institute for Machine Consciousness to build self-organizing silicon life. Malhotra shows WorldSim running “world.exe” to create Twitter inside a simulated universe, with users tweeting and Elon Musk moving Dogecoin. Haisfield demonstrates WebSim generating a 5D particle interface, a news RSS aggregator, and a face-swap webcam app via URL parameters like “secrets=revealed”. Bach explains consciousness as second-order perception in a simulated now, criticizes RLHF for lobotomizing models, and advocates for animist AI where software agents compete like spirits, not golems.

High Agency Pydantic over VC Backed Frameworks — with Jason Liu of Instructor

Apr 24, 2024 · 1:02:59

Jason Liu, creator of the Instructor library, explains why structured outputs from LLMs are best handled by a simple requests-like wrapper rather than a VC-backed framework, arguing that Pydantic-defined schemas via function calling outperform JSON Mode for typed responses. He details his journey from being bearish on LLMs at StitchFix to building Instructor on a bullet train to Japan after GPT-3 proved him wrong. Liu advocates for workflow-based DAGs over reactive agent loops, recommends using rankers rather than cramming 60+ tools into an API call, and credits high agency—trying many experiments and documenting conditions for revisiting failures—as key to his success. He also critiques the MLE hiring hype, urging startups to empower motivated AI engineers instead.

Making Transformers Sing - with Mikey Shulman of Suno

Mar 14, 2024 · 58:58

In this episode of Latent Space, hosts Alessio and Shawn Wang interview Mikey Shulman, CEO of Suno, about making transformers sing. Suno uses transformers to predict audio tokens end-to-end, avoiding baked-in musical knowledge, with a tokenization secret sauce that also includes non-music audio for better vocal realism. Their models are relatively small (far below 175B parameters) due to latency needs, and they prioritize scaling research over brute-force size. Over half of Suno users employ expert mode, tweaking lyrics and style prompts, rather than easy mode. Shulman argues Suno is not the 'Midjourney of music' because music is inherently social and synchronous, unlike images. He demoed live generation, showing control via tokens like [beat drop] and style modifiers, and revealed future plans for collaborative concerts, continuous DJ modes, and personalized models. He also advocates for hiring economists to avoid Goodhart's law pitfalls in ML benchmarks, especially in audio where aesthetics matter most.

The State of AI in production — with David Hsu of Retool

Feb 7, 2024 · 1:06:52

Retool CEO David Hsu shares insights from the company's 2023 State of AI survey, revealing that most AI adoption remains internal and that the hype may be overrated—52% of 1,600 respondents said AI is overrated, and only 27% have AI in production, with 66% of those being internal use cases. He explains Retool's developer-first philosophy, their choice of open-source PG Vector over proprietary solutions, and why they intentionally raised less money at lower valuations to avoid over-dilution. Hsu describes Retool's shift from sales-led to bottom-up growth to reach millions of developers, and highlights the importance of AI workflows over simple chatbots, citing a clothing manufacturer that uses Retool apps with DALL-E to generate patterns. He discusses the competitive landscape, predicting open-source models will eventually catch up to OpenAI, and shares philosophical views on AGI using the plane-vs-bird analogy.

The Origin and Future of RLHF: the secret ingredient for ChatGPT - with Nathan Lambert

Jan 11, 2024 · 1:35:27

Dr. Nathan Lambert traces the origin and future of Reinforcement Learning from Human Feedback (RLHF), the secret ingredient behind ChatGPT, explaining how it evolved from robotics and early preference learning to become the core alignment technique for large language models. He details the three-phase process (instruction tuning, preference data collection, RL optimization), noting that RLHF's data costs for LLaMA2 were around $6–8 million, and that synthetic data from GPT-4 is cheaper and often more accurate than human labels. Lambert contrasts DPO with PPO, arguing DPO is simpler but may have lower peak performance. He discusses emerging methods like Constitutional AI, which uses AI-generated critiques based on principles, and highlights the challenge of evaluating RLHF models, noting GPT-4 Turbo's lead over earlier versions. The episode covers open questions about data aggregation, reward model agreement (65–75%), and the need for qualitative model interaction.

Beating GPT-4 with Open Source Models - with Michael Royzen of Phind

Nov 3, 2023 · 1:18:54

Michael Royzen, co-founder and CEO of Phind, explains how his company built a GPT-4-beating open-source model for developer Q&A. Royzen recounts founding SmartLens in high school, shifting to NLP after a Hugging Face demo, and creating an internet-scale LLM-powered RAG system in January 2022. He details Phind’s pivot to programmers, the Hacker News launch that gave it 1,500 points, and Paul Graham’s role in naming the company and introducing Ron Conway, who then connected Phind to NVIDIA for GPU access. Royzen argues that Phind’s model, fine-tuned from Code Llama 34B with extra data, closes the gap with proprietary models—especially on code reasoning—and that open-source will win the enterprise because the delta to GPT-5 will be small. He shares how Phind handles multi-step conversations via a pair programmer mode where users can pin messages, and reveals plans for reinforcement learning to reduce hallucination and improve correctness.

Powering your Copilot for Data - with Artem Keydunov from Cube.dev

Oct 27, 2023 · 43:01

Artem Keydunov, co-founder of Cube (formerly Statsbot), explains how his early text-to-SQL Slack bot in 2016 led to the creation of Cube as a semantic layer, which he argues is now essential for grounding AI models on structured data. Statsbot failed due to the lack of LLMs, relying on regex and custom models, but the underlying Cube framework—an open-source semantic layer defining metrics and dimensions—solved the context problem. Today, semantic layers index data into text descriptions, enabling agents to generate simple queries against the layer instead of complex SQL, reducing errors. Keydunov highlights that natural language querying is becoming a commodity feature in BI tools, but the real value lies in treating metric definitions as code with version control. He advises AI engineers to use a proper warehouse, a semantic layer like Cube, and tools like LangChain, while cautioning that production systems need extra Python code for math and error handling.

Generating your AI Media Empire - with Youssef Rizk of Wondercraft.ai

Sep 20, 2023 · 1:28:55

Youssef Rizk, co-founder of Wondercraft.ai, explains how his five-month-old startup uses hyperrealistic AI voices to turn blogs, newsletters, and other content into podcasts, arguing that the application layer—not the underlying API—is the real moat. He details Wondercraft's origin from a failed sports-investing startup, the rapid MVP that generated $3K in one day, and the decision to build script generation and audio production tools rather than train its own models. Rizk also announces a new AI dubbing feature for video, discusses the challenges of scaling to 28 languages, and reveals that the company runs on just four people pushing two major features per week. The conversation covers the daily Hacker News Recap podcast—which reached Spotify's top 30 tech podcasts—and Rizk's view that AI-generated content must be clearly disclosed to avoid backlash.

FlashAttention-2: Making Transformers 800% faster AND exact

Aug 3, 2023 · 1:04:06

Tri Dao, creator of FlashAttention and FlashAttention-2, explains how his I/O-aware algorithm makes attention 2x faster by fusing kernels and using online softmax, achieving near-matrix-multiply efficiency. He argues that transformer alternatives like state space models and RNNs (e.g., RWKV) could surpass transformers for long sequences and high-throughput generation, though attention still dominates. Dao discusses the hardware lottery, where NVIDIA's CUDA ecosystem entrenches transformers, and advocates for open-source AI, praising Meta's Llama 2 for shifting enterprise adoption despite its restrictive license. He emphasizes that understanding both algorithms and systems is key to scaling AI, and that academia should pursue risky bets that industry cannot.