Why AI Can Generate a Song but Struggles with Music Theory
Om avsnittet
Ben Morss is a Developer Advocate at Mistral. He previously spent 9.5 years at Google as a Product Manager for advanced APIs in Chrome and a Developer Advocate for the web. He earned a bachelor's degree in Computer Science and Music from Harvard University and a doctorate in Music Composition from the University of California at Davis. He continues to make music and write about music theory.
Dan and Ben discuss how LLMs help people learn while still missing context and intent. Their discussion of information theory and training data leads into a debate about software craft when agents make code much cheaper to produce. Ben describes Chat Invaders, a cat-themed demo game, and a reunion sing-along app that broke with forty people present. He had not load-tested the app and did not determine what caused the failure.
They explore why working output does not guarantee value for a business or an audience. Ben wants musical assistance that can develop ideas and handle arranging work, but finds music theory explanations unreliable. The conversation ends with the human experience behind fiction and songs, and open questions about whether models could be conscious.
Chapters
- (00:00) - Learning with LLMs and the limits of explanation
- (05:24) - Model progress and conversational regressions
- (09:02) - Keeping up with AI and understanding the mechanics
- (11:10) - Information theory, entropy, and model compression
- (19:19) - Computing, music, and understanding structure
- (23:35) - Software craft versus speed of iteration
- (30:55) - Vibe coding and educational sample code
- (34:22) - The sing-along app that broke live
- (37:38) - Software demand and the power of verification
- (40:58) - Human judgment and useful business adoption
- (48:47) - AI composition and the missing musical assistant
- (52:38) - Music theory and gaps in training data
- (59:31) - Fiction, music, and the human behind the work
- (01:05:14) - Thinking, consciousness, and continuity
⠀
Links from the show
--------------------
- Mistral
- Genius
- information theory
- entropy
- lossy compression
- Claude Shannon
- Magenta
- Suno
- Markov chains
- WebSockets
- music theory
- augmented sixth chord
- stems
⠀
Guests
-------
Ben Morss, Developer Advocate, Mistral
⠀
Follow the podcast
-------------------
⠀
Follow Dan Gerlanc
-------------------
Agents and Engineers | Agentic AI, Software & Agentic Engineering med Dan Gerlanc finns tillgänglig på flera plattformar. Informationen på denna sida kommer från offentliga podd-flöden.