Training your own LLM, Domain specific models | Naveen Rao, cofounder and CEO of MosaicML

Naveen Rao is the cofounder and CEO of MosaicML, a platform that enables you to train and deploy large AI models on your data in your secure environment. They've raised funding from amazing investors such as Lux Capital, Data Collective, and Maverick Ventures. Prior to this, he was the cofounder of Nervana. It got acquired by Intel for $408M.

In this episode, we cover a range of topics including:
- AI compute workloads
- Compute platform for training and inference
- How to train your own LLM
- Ways to reduce the cost of training AI models
- Advantages of training domain specific models
- In-context learning
- Context windows of LLMs
- Moat of AI-infused businesses

Naveen's favorite book: The Righteous Mind (Author: Jonathan Haidt)

--------
Where to find Prateek Joshi:

Newsletter: https://prateekjoshi.substack.com 
Website: https://prateekj.com 
LinkedIn: https://www.linkedin.com/in/prateek-joshi-91047b19 
Twitter: https://twitter.com/prateekvjoshi