Ep 28: LangChain CEO Harrison Chase on the Current State of Eval and Agents and The LLM Apps that Will Define 2024

Last week LangChain announced a $20M Series A led by Sequoia and released the paid version of LangSmith, which has already been used by 1K+ teams and driven 80K signups. On this week’s episode of Unsupervised Learning, we sat down with LangChain Co-Founder and CEO Harrison Chase to talk about the current state of LLM evaluation, observability, and the agent landscape.

 

(0:00) intro 

(1:07) applications of AI in the sports world 

(3:26) what does LangChain do? 

(7:51) building with LangSmith 

(10:00) best AI eval practices 

(16:51) to what extent is eval generalizable? 

(21:11) the current agent landscape 

(29:35) balancing present and future at LangChain 

(36:27) using LangServe to deploy LangChain applications 

(41:37) more complex chatbots are coming 

(45:51) current AI practices that will become obsolete 

(48:55) over-hyped/under-hyped 

(49:25) bigger surprise in building LangChain 

(51:50) how ubiquitous will open-source models be in the future? 

(52:43) most exciting AI startups 

(56:07) being an AI “celebrity” 

(58:09) Jacob and Jordan debrief 

 

With your co-hosts:  

@jacobeffron  

- Partner at Redpoint, Former PM Flatiron Health  

@patrickachase  

- Partner at Redpoint, Former ML Engineer LinkedIn  

@ericabrescia  

- Former COO Github, Founder Bitnami (acq’d by VMWare)  

@jordan_segall  

- Partner at Redpoint

Jacob is an AI investor at Redpoint Ventures. He's led Redpoint's investments in companies like Abridge, Physical Intelligence & Legora. Follow Jacob on Twitter (@jacobeffron).

On Unsupervised Learning we probe the sharpest minds in AI in search for the truth about what's real today, what will be real in the future and what it all means for businesses and the world. If you're a builder, researcher or investor navigating the AI world, this podcast will help you deconstruct and understand the most important breakthroughs and see a clearer picture of reality. Subscribe to this show to stay up to date on our latest episodes.