Episode description
Episode description
Pedro Domingos, Professor Emeritus of Computer Science and Engineering at the University of Washington, is renowned for his research in machine learning, particularly for his work on Markov logic networks that allow for uncertain inference. He is also the author of the acclaimed book "The Master Algorithm".
Panel: Dr. Tim Scarfe
TOC:
[00:00:00] Introduction
[00:01:34] Galaxtica / misinformation / gatekeeping
[00:12:31] Is there a master algorithm?
[00:16:29] Limits of our understanding
[00:21:57] Intentionality, Agency, Creativity
[00:27:56] Compositionality
[00:29:30] Digital Physics / It from bit / Wolfram
[00:35:17] Alignment / Utility functions
[00:43:36] Meritocracy
[00:45:53] Game theory
[01:00:00] EA/consequentialism/Utility
[01:11:09] Emergence / relationalism
[01:19:26] Markov logic
[01:25:38] Moving away from anthropocentrism
[01:28:57] Neurosymbolic / infinity / tensor algerbra
[01:53:45] Abstraction
[01:57:26] Symmetries / Geometric DL
[02:02:46] Bias variance trade off
[02:05:49] What seen at neurips
[02:12:58] Chalmers talk on LLMs
[02:28:32] Definition of intelligence
[02:32:40] LLMs
[02:35:14] On experts in different fields
[02:40:15] Back to intelligence
[02:41:37] Spline theory / extrapolation
YT version: https://www.youtube.com/watch?v=C9BH3F2c0vQ
References;
The Master Algorithm [Domingos]
INFORMATION, PHYSICS, QUANTUM: THE SEARCH FOR LINKS [John Wheeler/It from Bit]
https://philpapers.org/archive/WHEIPQ.pdf
A New Kind Of Science [Wolfram]
https://www.amazon.co.uk/New-Kind-Science-Stephen-Wolfram/dp/1579550088
The Rationalist's Guide to the Galaxy: Superintelligent AI and the Geeks Who Are Trying to Save Humanity's Future [Tom Chivers]
https://www.amazon.co.uk/Does-Not-Hate-You-Superintelligence/dp/1474608795
The Status Game: On Social Position and How We Use It [Will Storr]
https://www.goodreads.com/book/show/60598238-the-status-game
Newcomb's paradox
https://en.wikipedia.org/wiki/Newcomb%27s_paradox
The Case for Strong Emergence [Sabine Hossenfelder]
https://philpapers.org/rec/HOSTCF-3
Markov Logic: An Interface Layer for Artificial Intelligence [Domingos]
https://www.morganclaypool.com/doi/abs/10.2200/S00206ED1V01Y200907AIM007
Note; Pedro discussed “Tensor Logic” - I was not able to find a reference
Neural Networks and the Chomsky Hierarchy [Grégoire Delétang/DeepMind]
https://arxiv.org/abs/2207.02098
Connectionism and Cognitive Architecture: A Critical Analysis [Jerry A. Fodor and Zenon W. Pylyshyn]
Every Model Learned by Gradient Descent Is Approximately a Kernel Machine [Pedro Domingos]
https://arxiv.org/abs/2012.00152
A Path Towards Autonomous Machine Intelligence Version 0.9.2, 2022-06-27 [LeCun]
https://openreview.net/pdf?id=BZ5a1r-kVsf
Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges [Michael M. Bronstein, Joan Bruna, Taco Cohen, Petar Veličković]
https://arxiv.org/abs/2104.13478
The Algebraic Mind: Integrating Connectionism and Cognitive Science [Gary Marcus]
https://www.amazon.co.uk/Algebraic-Mind-Integrating-Connectionism-D