Sveriges mest populära poddar
Generally Intelligent
Teknologi

Jonathan Frankle, MIT: The lottery ticket hypothesis and the science of deep learning

1 tim 21 min•10 september 2021

Jonathan Frankle (Google Scholar) (Website) is finishing his PhD at MIT, advised by Michael Carbin. His main research interest is using experimental methods to understand the behavior of neural networks. His current work focuses on finding sparse, trainable neural networks.

**Highlights from our conversation:** 

🕸  "Why is sparsity everywhere? This isn't an accident."

🤖  "If I gave you 500 GPUs, could you actually keep those GPUs busy?"

📊  "In general, I think we have a crisis of science in ML."

Fler avsnitt av Generally Intelligent

Visa alla avsnitt av Generally Intelligent
There will be a scientific theory of deep learning
•1 tim 33 min
Malleable software and human agency with Geoffrey Litt
•1 tim 32 min
From lawless spaces to true liberty: rethinking AI's role in society
•1 tim 39 min
Rylan Schaeffer, Stanford: Investigating emergent abilities and challenging dominant research ideas
•1 tim 3 min
Ari Morcos, DatologyAI: Leveraging data to democratize model training
•1 tim 34 min
Percy Liang, Stanford: The paradigm shift and societal effects of foundation models
•1 tim 2 min
Seth Lazar, Australian National University: Legitimate power, moral nuance, and the political philosophy of AI
•1 tim 56 min
Tri Dao, Stanford: FlashAttention and sparsity, quantization, and efficient inference
•1 tim 20 min
Jamie Simon, UC Berkeley: Theoretical principles for how neural networks learn and generalize
•1 tim 2 min
Bill Thompson, UC Berkeley: How cultural evolution shapes knowledge acquisition
•1 tim 15 min

Generally Intelligent med Kanjun Qiu finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.