Suno

The Ultimate Guide to Prompting - with Sander Schulhoff from LearnPrompting.org

Sep 20, 2024 · 1:07:09

Sander Schulhoff, author of The Prompt Report and founder of LearnPrompting, presents a comprehensive taxonomy of 58 prompting techniques and argues that prompt engineering is a skill everyone should have, not a specialized role. He categorizes techniques by problem-solving strategy (zero-shot, few-shot, thought generation, decomposition, ensembling, self-criticism) and debunks role prompting for accuracy-based tasks, showing an 'idiot' prompt outperformed a 'genius' prompt on MMLU. Schulhoff shares his experience running Hack-a-Prompt, which collected 600,000 malicious prompts and won best paper at EMNLP, and differentiates between prompt injection and jailbreaking. He advocates for automatic prompt engineering with DSPy, which beat his manual effort in 10 minutes, and previews Hack-a-Prompt 2.0, aiming for a $500,000 prize pool to generate real-world harms for safety tuning.

The Winds of AI Winter (Q2 Four Wars of the AI Stack Recap)

Aug 2, 2024 · 1:23:36

Swyx and Alessio recap Q2 2024 through their 'Four Wars' framework, arguing that the AI landscape is shifting from frontier model dominance to commoditization and vertical applications. They highlight Claude 3.5 Sonnet overtaking OpenAI on coding benchmarks, Llama 3.1's synthetic data approach enabling 7B models to rival GPT-4, Mistral Large 2's non-commercial license and lost open-source crown, and on-device models like Gemini Nano and Apple Intelligence. The Quality Data Wars see NYT suing OpenAI, Reddit licensing data for $200M+, and synthetic data proving real for math (AlphaProof near IMO gold) and code. The Multimodality War includes ChatGPT Voice Mode delayed, Meta's Chameleon for native fusion, and Google's PaliGemma for PDF extraction. The renamed LLM OS War covers agent protocols, memory databases, and the collapse of model cost by an order of magnitude every four months, pushing startups toward vertical services like Brightwave and Dropzone that sell labor, not tools. The episode ends with a CrowdStrike joke about agent safety.