Inside Hopper: Memory, Tiling, and the Tensor Core Engine

A deep dive into NVIDIA's Hopper GPUs and how they reinvent matrix multiplication. We explore the memory hierarchy from GM/HBM to on-chip SMEM, the role of coalescing, tiling, and the Tensor Core, and how TMA, swizzling, and pipelining keep data flowing to the math units—driving the AI accelerations behind modern transformers.

Note:  This podcast was AI-generated, and sometimes AI can make mistakes.  Please double-check any critical information.

Sponsored by Embersilk LLC