Computational Neuroscience, Machine Learning vs. Biological Learning, Large Language Models | Marius Pachitariu | Episode 235

Send us Fan Mail

How brains compute and learn, blending neuroscience with AI insights.

Episode Summary: Dr. Marius Pachitariu discusses how the brain computes information across scales, from single neurons to complex networks, using mice to study visual learning. He explains the differences between supervised and unsupervised learning, the brain’s high-dimensional processing, and how it compares to artificial neural networks like large language models. The conversation also covers experimental techniques, such as calcium imaging, and the role of reward prediction errors in learning.

About the guest: Marius Pachitariu, PhD is a group leader at the Janelia Research Campus, leading a lab focused on neuroscience with a blend of experimental and computational approaches.

Discussion Points:

• The brain operates at multiple scales, with single neurons acting as computational units and networks creating complex, high-dimensional computations.
• Pachitariu’s lab uses advanced tools like calcium imaging to record from tens of thousands of neurons simultaneously in mice.
• Unsupervised learning allows mice to form visual memories of environments without rewards, speeding up task learning later.
• Brain activity during sleep or anesthesia is highly correlated, unlike the high-dimensional, less predictable patterns during wakefulness.
• The brain expands sensory input dimensionality (e.g., from retina to visual cortex) to simplify complex computations, a principle also seen in artificial neural networks.
• Reward prediction errors, driven by dopamine, signal when expectations are violated, aiding learning by updating internal models.
• Large language models rely on self-supervised learning, predicting next words, but lack the forward-modeling reasoning humans excel at.

Related episode:

• M&M 44: Consciousness, Perception, Hallucinations, Selfhood, Neuroscience, Psychedelics & "Being You" | Anil Seth

*Not medical advice.

Support the show

Support my work:

• Good Chemistry: Personalized, science-based health consulting. Work with Dr. Nick Jikomes directly.
• Affiliate Partners: Visit this link to see my affiliate partners and get discounts codes for products & services to support health.

For all the ways you can support my efforts.