Sveriges mest populära poddar

Module 2: The MLP Layer - Where Transformers Store Knowledge

8 min•6 januari 2026

Shay explains where a transformer actually stores knowledge: not in attention, but in the MLP (feed-forward) layer. The episode frames the transformer block as a two-step loop: attention moves information between tokens, then the MLP transforms each token’s representation independently to inject learned knowledge.

Fler avsnitt av The AI Concepts Podcast

Module 6: RAG | Chunking - Where You Cut Decides What Gets Found

29 apr.•11 min

Module 6: RAG | Data Ingestion - Before Your Documents Can Be Found

27 apr.•12 min

Module 6: RAG | Vector Databases - Where That Meaning Gets Stored

27 apr.•10 min

Module 6: RAG | Embeddings - Teaching Machines to Understand Meaning

27 apr.•8 min

Module 6: The RAG Pipeline - End to End

25 apr.•13 min

Module 6: What is RAG and Why it Exists

25 apr.•9 min

Module 5: Reasoning Models

17 apr.•8 min

Module 5: Structured Output and the Language of Software

17 apr.•8 min

Module 5: System Prompts and the Invisible Rules

17 apr.•11 min

Module 5: Chain of Thought Prompting

17 apr.•7 min

The AI Concepts Podcast med Sheetal ’Shay’ Dhar finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.