AI Agents: Why You Need to Be at the Helm | Salesforce's Chief Ethical and Humane Use Officer

AI agents now act on more decisions than any manager can review, so the choice of which work goes to an agent and where a person stays in charge decides the result. Paula Goldman, Salesforce's Chief Ethical and Humane Use Officer and EVP of Product, explains why the human in the loop model fails for agents and what replaces it: human at the helm. Drawing on her book, Manage the Machine, she walks through choosing use cases, setting an agent's boundaries, audit trails, token spend, and the accountability structure that CEOs must put in place.

YOU'LL DISCOVER

✅ The test that decides a use case: not whether AI can do the work but whether it should, with the healthcare scheduling and 1-800Accountant tax examples

✅ Why the human in the loop idea from Cold War missile defense breaks when one agent run leaves 50,000 data points no person can verify one by one, and what human at the helm means instead

✅ Why a public tracker that now counts well past 1,000 court cases of AI-hallucinated citations points to overtrust, and the junior employee method for expanding an agent's scope

✅ The first step in setting up an agent: its goal, off-limits topics, escalation triggers, and domain tripwires such as brand voice

✅ How deterministic controls and probabilistic models work together, and why audit trails give you receipts for what an agent did

✅ The IKEA couch story and the human goes first method that stops AI from reverting to the mean

✅ How to manage token spend by allocating it per use case and matching the model to the job

✅ Advice for CEOs: a real accountability structure for AI and employees at the table

⏱️ TIMESTAMPS

0:00 Introduction

0:27 Not just can AI, but should it

6:57 Human at the helm, not the loop

11:26 AI has data, humans have context

16:24 AI finds insights, people catch mistakes

19:45 Demand AI you can monitor

24:16 Set the agent's boundaries in advance

28:58 Audit trails give you the receipts

34:58 Human goes first, then the AI

40:35 AI is simpler than it seems

45:12 Society sets the floor, companies experiment

48:12 AI needs a clear accountability structure

Join us live and ask the guests your own questions: https://www.cxotalk.com/subscribe

Show notes, transcript, and summary: https://www.cxotalk.com/episode/salesforces-chief-ethical-and-humane-use-officer-how-to-build-great-ai-use-cases

Episode 931 | Recorded September 11, 2026

#CXOTalk #AIAgents #AgenticAI #EnterpriseAI #Salesforce #AIEthics #AIGovernance #ResponsibleAI #CIO