Episode 12: AI governance: automated decisions and human responsibility

AI can now make or support decisions that were once made only by humans. But there is one thing AI cannot take on: responsibility.

When an AI system recommends, approves, rejects, prioritises or acts, a human or organisation still needs to be accountable for the outcome. Meaningful human oversight requires more than putting a person at the end of the process and asking them to click the Approve button. The person needs access to the right information: what AI decided, why, what data influenced the decision, what uncertainty exists, and what risks or alternatives were considered.

In this episode, we explore the gap between AI decision-making and human responsibility. We discuss what humans need in order to meaningfully sign off on AI-supported decisions, what reliable oversight could look like, and whether organisations are designing their AI systems around accountability.

Links:

- Enquiry discussion on BeyondQuality: https://github.com/BeyondQuality/beyondquality/discussions/47

- AI Era Testing research: https://beyondquality.org/research/ai-era-testing/