Sveriges mest populära poddar
Max Agency

The tool design tricks behind Benchling's AI agents | Nick Larus-Stone

51 min4 juni 2026

Nick Larus-Stone is the Head of AI at Benchling, the R&D data platform that life science companies use to store and manage their experiments, samples, instruments, and analysis. Benchling has been around for since 2012. In October 2025, it launched Benchling AI, an intelligence layer with a chat interface, backed by an agent, that helps scientists find data, design experiments, and write reports. Nick came to Benchling through its acquisition of Sphinx Bio, the analysis startup he founded. In this conversation, Nick walks through what it takes to build agents for scientific work, and where the playbook from coding agents holds up and where it breaks down.

We also discuss:

  • Why Benchling invests so heavily in getting clean data upfront
  • How they cross-check answers between models to get more out of each one
  • Why and how Benchling leans on production traces
  • Where AI actually helps science today, and where it still gets stuck
  • Why understanding LLMs is closer to biology than software engineering

Timestamps:

00:00 Intro

01:22 What Benchling AI is, and the 14-year data platform underneath it

04:36 Why a decade of structured data is a core advantage

05:57 The architecture under the hood

08:28 Similarities and differences compared to a coding harness

11:14 Benchling’s multi-agent architectures

14:36 Dealing with verifiable vs non-verifiable tasks

16:19 Doing evals when clean benchmarks aren’t possible

18:13 Context engineering: SQL vs. file-based harnesses

22:11 Memory: agents that create and update their own skills

25:30 What user education for scientists looks like

30:33 Why understanding LLMs is closer to biology than software

33:28 When will agents discover a novel cure for disease?

44:58 The future of harnesses in science

48:13 Why fine-tuning on biology hasn't beaten frontier models

References:

Where to find Nick:

Where to find Harrison:

Where to find LangChain:

Send feedback or questions to [email protected]

Max Agency med LangChain finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.