Sveriges mest populära poddar
Unsupervised Learning with Jacob Effron
Teknologi

Ep 7: Co-Creator of Databricks Dolly Mike Conover on Open-Source LLMs

49 min•11 maj 2023

Patrick and Jacob sit down with Mike Conover, Staff Software Engineer at Databricks and Co-Creator of Databricks Dolly, the world’s first truly open instruction-tuned LLM, to discuss the magic behind Dolly, Alpaca and other instruction-tuned LLMs, the unreasonable effectiveness of fine-tuning, how they got all Databricks employees to help them curate the Dolly dataset (hint: google forms), and more.

 

(0:00) - Intro

(5:54) - The birth of Dolly

(12:03) - Data curation at Databricks

(15:34) - Advice for building LLMs

(24:10) - The future of instruction-tuning datasets

(30:43) - UI innovation

(38:16) - The future of machine learning infrastructure

(42:05) - How SkipFlag would be different with the tools we have today

(47:01) - What Mike has learned since Dolly

 

With your co-hosts:

@jasoncwarner

- Former CTO GitHub, VP Eng Heroku & Canonical

@ericabrescia

- Former COO Github, Founder Bitnami (acq’d by VMWare)

@patrickachase

- Partner at Redpoint, Former ML Engineer LinkedIn

@jacobeffron

- Partner at Redpoint, Former PM Flatiron Health

Fler avsnitt av Unsupervised Learning with Jacob Effron

Visa alla avsnitt av Unsupervised Learning with Jacob Effron
Ep 85: Has AI Infra Stabilized, FM Vibe Shift, & What's Next for Coding Agents
•55 min
Ep 84: OpenAI’s Chief Scientist on Continual Learning Hype, RL Beyond Code, & Future Alignment Directions
•59 min
Ep 83: Owning the System of Record, AI-Native Org Charts, & Why ITSM is The Most Vulnerable Legacy Category
•54 min
Ep 82: Behind Legora's $550M Raise, Model Competition, Doubling Revenue Every Quarter, & US Expansion
•54 min
Ep 81: Ex-OpenAI Researcher On Why He Left, His Honest AGI Timeline, & The Limits of Scaling RL
•1 tim 3 min
AI Vibe Check: The Actual Bottleneck In Research, SSI’s Mystique, & Spicy 2026 Predictions
•1 tim 18 min
Ep 80: CEO of Surge AI Edwin Chen on Why Frontier Labs Are Diverging, RL Environments & Developing Model Taste
•48 min
Ep 79: OpenAI's Head of Product on How the Best Teams Build, Ship and Scale AI Products
•56 min
Ep 78: Jordan Schneider, Host of China Talk, on AI Race, Key Policy Decisions & Unpacking Geopolitical Chip Tension
•1 tim 13 min
Ep 77: Anthropic’s Dianne Na Penn on Opus 4.5, Rethinking Model Scaffolding & Safety as a Competitive Advantage
•42 min

Unsupervised Learning with Jacob Effron med by Redpoint Ventures finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.