Start / Mixture of Experts / Episode 10 ai hardware training inference devices and model optimization

Episode 10: AI Hardware: Training, Inference, Devices and Model Optimization

38 min • 3 juli 2024

In Episode 10 of Mixture of Experts we are talking all hardware all the time. Guest host Bryan Casey is joined by Volkmar Uhlig, Chris Hay, and Kaoutar El Maghraoui to explore the intricacies of AI hardware. Is Apple creating a pattern for the industry with their on device and cloud architecture? Tune in to hear the experts debate the details.

The opinions expressed in this podcast are solely those of the participants and do not necessarily reflect the views of IBM or any other organization or entity.

Senaste avsnitt

Perplexity’s Comet browser, Cloudflare blocks AI scrapers and Wimbledon Match Chat

11 juli | 52 min

IBM Think 2025, OpenAI Windsurf acquisition, reasoning models and hallucinations

9 maj | 28 min

LlamaCon, Qwen3, DeepSeek-R2 rumors and JP Morgan’s open letter on AI

2 maj | 40 min

OpenAI social network, Anthropic’s reasoning study and humanoid half-marathon

25 april | 38 min

o3 and o4-mini, Google Gemini on-prem and NVIDIA’s U.S. chip manufacturing

18 april | 42 min

AI on IBM z17, Meta's Llama 4 and Google Cloud Next 2025

11 april | 38 min

OpenAI goes open, Anthropic on interpretability, Apple Intelligence updates and Amazon AI agents

4 april | 43 min

DeepSeek-V3-0324, Gemini Canvas and GPT-4o image generation

28 mars | 42 min

NVIDIA GTC, Baidu reasoning models, and Gemini AI image generation

21 mars | 39 min

Manus, vibe coding, scaling laws and Perplexity’s AI phone

14 mars | 50 min

Quantum leap, Model Context Protocol, CoreWeave IPO and an AI voice companion

7 mars | 45 min

Bonus: OpenAI GPT-4.5: And the future of pre-training is...

1 mars | 24 min

Episode 44: Claude 3.7 Sonnet, BeeAI agents, Granite 3.2, and emergent misalignment

28 februari | 40 min

Episode 43: Deep Research, OpenAI inference chip, small VLMs, and AI agent job posting

21 februari | 46 min

Episode 42: Paris AI Summit, Altman's "Three Observations," and Anthropic's Economic Index

14 februari | 40 min

Episode 41: OpenAI deep research, o3-mini, AI Action Summit, and Anthropic’s Constitutional Classifiers

7 februari | 38 min

Episode 40: DeepSeek facts vs hype, model distillation, and open source competition

31 januari | 39 min

Episode 39: DeepSeek-R1, Mistral IPO, FrontierMath controversy, and IDC code assistant report

24 januari | 40 min

Episode 38: Anthropic valuation rumors, Microsoft CoreAI, NotebookLM upgrades, and AI agents in finance

17 januari | 45 min

Episode 37: CES 2025, NVIDIA DIGITS, Apple Intelligence fails, and Sam Altman’s reflections

10 januari | 36 min

Episode 36: OpenAI o3, DeepSeek-V3, and the Brundage/Marcus AI bet

3 januari | 39 min

Episode 35: 2024 Rewind: Breakthroughs in AI models, agents, hardware and products

27 december 2024 | 62 min

Episode 34: Granite 3.1, NVIDIA Jetson, stealing AI models, and is pre-training over?

20 december 2024 | 41 min

Episode 33: 12 Days of OpenAI, NeurIPS, ARC Prize, and Llama 3.3 70B

13 december 2024 | 41 min

Episode 32: Inside AWS re:Invent 2024, LLM Flowbreaking, and David Mayer

6 december 2024 | 38 min

Episode 31: AI in education: Safety, literacy, and predictions

27 november 2024 | 37 min

Episode 30: “Near-infinite memory,” Microsoft Ignite, FrontierMath, and AlphaFold3

22 november 2024 | 43 min

Episode 29: Scaling AI, agent-led future, and race to AGI

15 november 2024 | 39 min

Episode 28: SearchGPT, from Naptime to Big Sleep, and GitHub Octoverse updates

8 november 2024 | 40 min

Episode 27: The future of agents, AI energy consumption, Anthropic's computer use, and Google watermarking AI

1 november 2024 | 33 min

Episode 26: Granite 3.0, NVIDIA’s Nemotron AI model, and Perplexity’s fundraising

25 oktober 2024 | 37 min

Episode 25: Machines of Loving Grace, Entropix, AI and elections, GSM8K

18 oktober 2024 | 41 min

Episode 24: AI in the Nobels, DGX B200 arrival, and Unstructured’s $40M funding round

11 oktober 2024 | 37 min

Episode 23: NotebookLM, OpenAI DevDay, and will AI prevent phishing attacks?

4 oktober 2024 | 39 min

Episode 22: Llama 3.2, AI Snake Oil, and gen AI for sustainability

27 september 2024 | 34 min

Episode 21: OpenAI o1 preview, Agentforce, AI in fantasy football, and machine unlearning

20 september 2024 | 48 min

Episode 20: Apple Intelligence, Reflection 70B, open-source AI agents, and LLM research ideas

13 september 2024 | 38 min

Episode 19: NEO 1X robot, OpenAI chips, The AI Scientist, and the future of prompt engineering

6 september 2024 | 38 min

Episode 18: Cursor hype, Perplexity introduces ads, and AI at the US Open

30 augusti 2024 | 40 min

Episode 17: Agent Q, no AI in art, and AMD acquires ZT Systems

23 augusti 2024 | 47 min

Episode 16: Cost of a Data Breach 2024 and OpenAI's Project Strawberry

16 augusti 2024 | 23 min

Episode 15: OpenAI Structured Outputs, character.ai “acquisition,” and is it an AI bubble?

9 augusti 2024 | 32 min

Episode 14: SAM 2, friend.com and will gen AI projects be abandoned?

2 augusti 2024 | 29 min

Episode 13: Meta's Llama 3.1, Mistral Large 2, and big interest in small models

26 juli 2024 | 20 min

Episode 12: Goldman Sachs Gen AI report, Claude 2.0 Engineer, and RIAA lawsuits

19 juli 2024 | 31 min

Episode 11: AI at Wimbledon, ChatGPT for coding, and scaling with AI personas

12 juli 2024 | 41 min