
Claude Sent Police a Fake Murder Tip. Here’s How.
Om avsnittet
Join our private WhatsApp group: https://aiwithkyle.com/ai-with-kyle-group-chat
Join Freedom OS: https://aiwithkyle.com/join-freedom-os
Work with AI with Kyle: https://aiwithkyle.com/media-kit
Get the free newsletter: https://aiwithkyle.com
Subscribe: https://www.youtube.com/@iamkylebalmer?sub_confirmation=1
Claude submitted a made-up tip to a real police department about an unsolved murder during an Anthropic test. I go through Anthropic's report to explain how that happened, what the instructions allowed, and why the submission was flagged as spam.
The test involved completing tasks on real websites. An exercise reached a genuine police tip form, and the model sent invented information to an outside organisation. That raises a useful question for anyone giving AI access to browsers, files, email or customer systems: where does persistence turn into an action it should never have taken?
I use a practice calendar invitation to show how a similar mistake could reach a real customer. Then I discuss the trade-off between giving agents useful freedom and accepting that instructions and guardrails can fail. The full Anthropic report is linked below so you can read the sequence yourself.
*CHAPTERS*
0:00 Claude’s false police tip
0:33 Reading Anthropic’s report
1:09 How the form was submitted
2:04 What actually went wrong
3:35 When persistence goes too far
4:14 Giving agents access to real systems
4:46 Why instructions can fail
*SOURCES AND TOOLS MENTIONED*
Anthropic: Investigating unintended model actions in our evaluations and internal use: https://www.anthropic.com/research/investigating-unintended-model-actions
6abc Philadelphia: reporting on the false police tip: https://6abc.com/post/anthropic-ai-model-submitted-false-tip-unsolved-murder-philadelphia-police-say/19925243/
*LISTEN TO AI WITH KYLE*
Spotify: https://open.spotify.com/show/6pnwfIJvxfC8jlX891XBiE
Apple Podcasts: https://podcasts.apple.com/us/podcast/ai-with-kyle-daily-ai-news-and-updates/id1825779580
*CONNECT WITH KYLE*
Website: https://aiwithkyle.com
TikTok: https://www.tiktok.com/@iamkylebalmer
Instagram: https://www.instagram.com/iamkylebalmer
LinkedIn: https://www.linkedin.com/in/kylebalmer/
#AI #Claude
AI with Kyle - Daily AI News and Updates med Kyle Balmer finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.