Computational Neuroscience, Machine Learning vs. Biological Learning, Large Language Models | Marius Pachitariu | Episode 235
Episode description
How brains compute and learn, blending neuroscience with AI insights.
Episode Summary: Dr. Marius Pachitariu discusses how the brain computes information across scales, from single neurons to complex networks, using mice to study visual learning. He explains the differences between supervised and unsupervised learning, the brain’s high-dimensional processing, and how it compares to artificial neural networks like large language models. The conversation also covers experimental techniques, such as calcium imaging, and the role of reward prediction errors in learning.
About the guest: Marius Pachitariu, PhD is a group leader at the Janelia Research Campus, leading a lab focused on neuroscience with a blend of experimental and computational approaches.
Discussion Points:
- The brain operates at multiple scales, with single neurons acting as computational units and networks creating complex, high-dimensional computations.
- Pachitariu’s lab uses advanced tools like calcium imaging to record from tens of thousands of neurons simultaneously in mice.
- Unsupervised learning allows mice to form visual memories of environments without rewards, speeding up task learning later.
- Brain activity during sleep or anesthesia is highly correlated, unlike the high-dimensional, less predictable patterns during wakefulness.
- The brain expands sensory input dimensionality (e.g., from retina to visual cortex) to simplify complex computations, a principle also seen in artificial neural networks.
- Reward prediction errors, driven by dopamine, signal when expectations are violated, aiding learning by updating internal models.
- Large language models rely on self-supervised learning, predicting next words, but lack the forward-modeling reasoning humans excel at.
Related episode:
- M&M 44: Consciousness, Perception, Hallucinations, Selfhood, Neuroscience, Psychedelics & "Being You" | Anil Seth
*Not medical advice.
Health Products by M&M Partners:
- AquaTru: Water filtration devices that remove microplastics, metals, bacteria, and more from your drinking water. Through link, $100 off AquaTru Carafe, Classic & Under Sink Units; $300 off Freestanding models.
- OmegaQuant: At-home blood testing to see fatty acid profiles, including omega-3 fatty acids. Use link to see options and support M&M.
- SiPhox Health: Comprehensive, cost-effective bloodwork from the comfort of home. Use code TRIKOMES for 20% off.
- KetoCitra—Ketone body BHB + electrolytes formulated for kidney health. Use code MIND20 for 20% off any subscription (cancel anytime)
- SporesMD: Premium mushrooms products (gourmet mushrooms, nootropics, research). Use code 'nickjikomes' for 20% off.
For all the ways you can support my efforts