Machine Learning Street Talk (MLST)

#96 Prof. PEDRO DOMINGOS - There are no infinities, utility functions, neurosymbolic


Listen Later

Pedro Domingos, Professor Emeritus of Computer Science and Engineering at the University of Washington, is renowned for his research in machine learning, particularly for his work on Markov logic networks that allow for uncertain inference. He is also the author of the acclaimed book "The Master Algorithm".


Panel: Dr. Tim Scarfe


TOC:

[00:00:00] Introduction

[00:01:34] Galaxtica / misinformation / gatekeeping

[00:12:31] Is there a master algorithm?

[00:16:29] Limits of our understanding 

[00:21:57] Intentionality, Agency, Creativity

[00:27:56] Compositionality 

[00:29:30] Digital Physics / It from bit / Wolfram 

[00:35:17] Alignment / Utility functions

[00:43:36] Meritocracy  

[00:45:53] Game theory 

[01:00:00] EA/consequentialism/Utility

[01:11:09] Emergence / relationalism 

[01:19:26] Markov logic 

[01:25:38] Moving away from anthropocentrism 

[01:28:57] Neurosymbolic / infinity / tensor algerbra

[01:53:45] Abstraction

[01:57:26] Symmetries / Geometric DL

[02:02:46] Bias variance trade off 

[02:05:49] What seen at neurips

[02:12:58] Chalmers talk on LLMs

[02:28:32] Definition of intelligence

[02:32:40] LLMs 

[02:35:14] On experts in different fields

[02:40:15] Back to intelligence

[02:41:37] Spline theory / extrapolation


YT version:  https://www.youtube.com/watch?v=C9BH3F2c0vQ


References;


The Master Algorithm [Domingos]

https://www.amazon.co.uk/s?k=master+algorithm&i=stripbooks&crid=3CJ67DCY96DE8&sprefix=master+algorith%2Cstripbooks%2C82&ref=nb_sb_noss_2


INFORMATION, PHYSICS, QUANTUM: THE SEARCH FOR LINKS [John Wheeler/It from Bit]

https://philpapers.org/archive/WHEIPQ.pdf


A New Kind Of Science [Wolfram]

https://www.amazon.co.uk/New-Kind-Science-Stephen-Wolfram/dp/1579550088


The Rationalist's Guide to the Galaxy: Superintelligent AI and the Geeks Who Are Trying to Save Humanity's Future [Tom Chivers]

https://www.amazon.co.uk/Does-Not-Hate-You-Superintelligence/dp/1474608795


The Status Game: On Social Position and How We Use It [Will Storr]

https://www.goodreads.com/book/show/60598238-the-status-game


Newcomb's paradox

https://en.wikipedia.org/wiki/Newcomb%27s_paradox


The Case for Strong Emergence [Sabine Hossenfelder]

https://philpapers.org/rec/HOSTCF-3


Markov Logic: An Interface Layer for Artificial Intelligence [Domingos]

https://www.morganclaypool.com/doi/abs/10.2200/S00206ED1V01Y200907AIM007


Note; Pedro discussed “Tensor Logic” - I was not able to find a reference


Neural Networks and the Chomsky Hierarchy [Grégoire Delétang/DeepMind]

https://arxiv.org/abs/2207.02098


Connectionism and Cognitive Architecture: A Critical Analysis [Jerry A. Fodor and Zenon W. Pylyshyn]

https://ruccs.rutgers.edu/images/personal-zenon-pylyshyn/proseminars/Proseminar13/ConnectionistArchitecture.pdf


Every Model Learned by Gradient Descent Is Approximately a Kernel Machine [Pedro Domingos]

https://arxiv.org/abs/2012.00152


A Path Towards Autonomous Machine Intelligence Version 0.9.2, 2022-06-27 [LeCun]

https://openreview.net/pdf?id=BZ5a1r-kVsf


Geometric Deep Learning: Grids, Groups, Graphs, Geodesics, and Gauges [Michael M. Bronstein, Joan Bruna, Taco Cohen, Petar Veličković]

https://arxiv.org/abs/2104.13478


The Algebraic Mind: Integrating Connectionism and Cognitive Science [Gary Marcus]

https://www.amazon.co.uk/Algebraic-Mind-Integrating-Connectionism-D

...more
View all episodesView all episodes
Download on the App Store

Machine Learning Street Talk (MLST)By Machine Learning Street Talk (MLST)

  • 4.7
  • 4.7
  • 4.7
  • 4.7
  • 4.7

4.7

83 ratings


More shows like Machine Learning Street Talk (MLST)

View all
Data Skeptic by Kyle Polich

Data Skeptic

470 Listeners

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence) by Sam Charrington

The TWIML AI Podcast (formerly This Week in Machine Learning & Artificial Intelligence)

434 Listeners

Super Data Science: ML & AI Podcast with Jon Krohn by Jon Krohn

Super Data Science: ML & AI Podcast with Jon Krohn

296 Listeners

NVIDIA AI Podcast by NVIDIA

NVIDIA AI Podcast

324 Listeners

Practical AI by Practical AI LLC

Practical AI

190 Listeners

Google DeepMind: The Podcast by Hannah Fry

Google DeepMind: The Podcast

201 Listeners

Last Week in AI by Skynet Today

Last Week in AI

281 Listeners

Dwarkesh Podcast by Dwarkesh Patel

Dwarkesh Podcast

354 Listeners

No Priors: Artificial Intelligence | Technology | Startups by Conviction

No Priors: Artificial Intelligence | Technology | Startups

125 Listeners

This Day in AI Podcast by Michael Sharkey, Chris Sharkey

This Day in AI Podcast

190 Listeners

Latent Space: The AI Engineer Podcast by swyx + Alessio

Latent Space: The AI Engineer Podcast

63 Listeners

"Upstream" with Erik Torenberg by Erik Torenberg

"Upstream" with Erik Torenberg

64 Listeners

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis by Nathaniel Whittemore

The AI Daily Brief (Formerly The AI Breakdown): Artificial Intelligence News and Analysis

424 Listeners

AI + a16z by a16z

AI + a16z

33 Listeners

Training Data by Sequoia Capital

Training Data

36 Listeners