Clément Delangue — The Power of the Open Source Community

Clem explains the virtuous cycles behind the creation and success of Hugging Face, and shares his thoughts on where NLP is heading.

---

Clément Delangue is co-founder and CEO of Hugging Face, the AI community building the future. Hugging Face started as an open source NLP library and has quickly grown into a commercial product used by over 5,000 companies.

Connect with Clem:

📍 Twitter: https://twitter.com/ClementDelangue

📍 LinkedIn: https://www.linkedin.com/in/clementdelangue/

---

🌟 Transcript: http://wandb.me/gd-clement-delangue 🌟

⏳ Timestamps:

0:00 Sneak peek and intro

0:56 What is Hugging Face?

4:15 The success of Hugging Face Transformers

7:53 Open source and virtuous cycles

10:37 Working with both TensorFlow and PyTorch

13:20 The "Write With Transformer" project

14:36 Transfer learning in NLP

16:43 BERT and DistilBERT

22:33 GPT

26:32 The power of the open source community

29:40 Current applications of NLP

35:15 The Turing Test and conversational AI

41:19 Why speech is an upcoming field within NLP

43:44 The human challenges of machine learning

Links Discussed:

📍 Write With Transformer, Hugging Face Transformer's text generation demo: https://transformer.huggingface.co/

📍 "Attention Is All You Need" (Vaswani et al., 2017): https://arxiv.org/abs/1706.03762

📍 EleutherAI and GPT-Neo: https://github.com/EleutherAI/gpt-neo]

📍 Rasa, open source conversational AI: https://rasa.com/

📍 Roblox article on BERT: https://blog.roblox.com/2020/05/scaled-bert-serve-1-billion-daily-requests-cpus/

---

Get our podcast on these platforms:

👉 Apple Podcasts: http://wandb.me/apple-podcasts​​

👉 Spotify: http://wandb.me/spotify​

👉 Google Podcasts: http://wandb.me/google-podcasts​​

👉 YouTube: http://wandb.me/youtube​​

👉 Soundcloud: http://wandb.me/soundcloud​

Join our community of ML practitioners where we host AMAs, share interesting projects and meet other people working in Deep Learning:

http://wandb.me/slack​​

Check out Fully Connected, which features curated machine learning reports by researchers exploring deep learning techniques, Kagglers showcasing winning models, industry leaders sharing best practices, and more:

https://wandb.ai/fully-connected