650: SparseGPT: Remove 100 Billion Parameters but Retain 100% Accuracy

Om avsnittet

SparseGPT is a noteworthy one-shot pruning technique that can halve the size of large language models like GPT-3 without adversely affecting accuracy. In this episode, Jon Krohn provides an overview of this development and explains its commercial and environmental implications.

Additional materials: www.superdatascience.com/650

Interested in sponsoring a SuperDataScience Podcast episode? Visit JonKrohn.com/podcast for sponsorship information.

Om avsnittet

Fler avsnitt

1038: AI’s Contentious Math Breakthroughs

1037: Recursive Self-Improvement: The Eureka Machine, with Dr. Richard Socher

1036: Is AI Holding Kids Back from Learning?

1035: Workslop, Glass Cliffs and Inviting Your Fears to Tea, with Carly Taylor

1034: In Case You Missed It in September 2026

1033: Workslop: The Hidden Cost of AI-Generated Work, with Prof. Jeff Hancock and Dr. Kate Niederhoffer

1032: Agents Need 10x More Data Than Humans, with Salesforce’s CDO Michael Andrew

1031: Tokenomics: Why Your Agentic AI Bill Is Exploding (and How to Fix It), with Tyler Cox and Ish Shah

1030: Garbage In, Gospel Out: Why Agents Need Better Data, with Salesforce's Gaurav Pathak

1029: How AI Brought a Podcast Back From the Dead, with Linear Digressions’ Katie Malone